[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:31:23 dist-test-slave-cvwc krb5kdc[31042](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:31:23 dist-test-slave-cvwc krb5kdc[31042](info): set up 2 sockets
Aug 09 06:31:23 dist-test-slave-cvwc krb5kdc[31042](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260809 06:31:24.874235 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.007s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:31:24 dist-test-slave-cvwc krb5kdc[31042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:31:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:31:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:31:25.027375 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:45283
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:41701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:45283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:25.340170 31064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:25.340436 31064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:25.340559 31064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:25.347523 31064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:31:25.347625 31064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:25.347704 31064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:25.347787 31064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:31:25.347847 31064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:31:25.357231 31064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:41701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:45283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:45283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:25.358543 31064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:25.359824 31064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:25.372956 31072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:25.372979 31075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:25.372917 31073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:25.373584 31064 server_base.cc:1034] running on GCE node
I20260809 06:31:25.374428 31064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:25.375747 31064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:25.376952 31064 hybrid_clock.cc:648] HybridClock initialized: now 1786257085376873 us; error 64 us; skew 500 ppm
I20260809 06:31:25.377266 31064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:25 dist-test-slave-cvwc krb5kdc[31042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:25.380441 31064 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:31:25.381821 31064 webserver.cc:460] Webserver started at http://127.30.78.126:45637/ using document root <none> and password file <none>
I20260809 06:31:25.382457 31064 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:25.382551 31064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:25.382797 31064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:25.385842 31064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "d36736c462b441088b20cd89c3ea8c27"
format_stamp: "Formatted at 2026-08-09 06:31:25 on dist-test-slave-cvwc"
server_key: "98165a9df44d401f49d827cecb916b87"
server_key_iv: "7cb46c50a789789d01c6c72725534aeb"
server_key_version: "encryptionkey@0"
I20260809 06:31:25.386596 31064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "d36736c462b441088b20cd89c3ea8c27"
format_stamp: "Formatted at 2026-08-09 06:31:25 on dist-test-slave-cvwc"
server_key: "98165a9df44d401f49d827cecb916b87"
server_key_iv: "7cb46c50a789789d01c6c72725534aeb"
server_key_version: "encryptionkey@0"
I20260809 06:31:25.391402 31064 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:31:25.394567 31089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:25.395745 31064 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:31:25.395911 31064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "d36736c462b441088b20cd89c3ea8c27"
format_stamp: "Formatted at 2026-08-09 06:31:25 on dist-test-slave-cvwc"
server_key: "98165a9df44d401f49d827cecb916b87"
server_key_iv: "7cb46c50a789789d01c6c72725534aeb"
server_key_version: "encryptionkey@0"
I20260809 06:31:25.396080 31064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:25.420042 31064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:25.423728 31064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:25.423985 31064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:25.440666 31064 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:45283
I20260809 06:31:25.440685 31157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:45283 every 8 connection(s)
I20260809 06:31:25.441941 31064 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:31:25.445521 31158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:25.449497 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31064
I20260809 06:31:25.449846 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:31:25.452243 31033 external_mini_cluster.cc:1428] Setting key b23c70b7de676a3563f20de4e1bb41ad
I20260809 06:31:25.457698 31158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27: Bootstrap starting.
I20260809 06:31:25.460716 31158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:25.461680 31158 log.cc:824] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:25.464314 31158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27: No bootstrap required, opened a new log
I20260809 06:31:25.473416 31158 raft_consensus.cc:348] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36736c462b441088b20cd89c3ea8c27" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45283 } }
I20260809 06:31:25.473901 31158 raft_consensus.cc:374] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:25.474009 31158 raft_consensus.cc:729] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d36736c462b441088b20cd89c3ea8c27, State: Initialized, Role: FOLLOWER
I20260809 06:31:25.474647 31158 consensus_queue.cc:260] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36736c462b441088b20cd89c3ea8c27" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45283 } }
I20260809 06:31:25.474866 31158 raft_consensus.cc:388] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:31:25.475000 31158 raft_consensus.cc:482] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:31:25.475154 31158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:25.477890 31158 raft_consensus.cc:504] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36736c462b441088b20cd89c3ea8c27" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45283 } }
I20260809 06:31:25.478355 31158 leader_election.cc:302] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d36736c462b441088b20cd89c3ea8c27; no voters:
I20260809 06:31:25.478963 31158 leader_election.cc:288] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:31:25.479102 31166 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:25.480810 31158 sys_catalog.cc:564] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:31:25.482008 31166 raft_consensus.cc:686] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [term 1 LEADER]: Becoming Leader. State: Replica: d36736c462b441088b20cd89c3ea8c27, State: Running, Role: LEADER
Aug 09 06:31:25 dist-test-slave-cvwc krb5kdc[31042](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:25.482674 31166 consensus_queue.cc:237] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36736c462b441088b20cd89c3ea8c27" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45283 } }
I20260809 06:31:25.485954 31168 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d36736c462b441088b20cd89c3ea8c27. Latest consensus state: current_term: 1 leader_uuid: "d36736c462b441088b20cd89c3ea8c27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36736c462b441088b20cd89c3ea8c27" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45283 } } }
I20260809 06:31:25.486338 31168 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:25.486847 31167 sys_catalog.cc:455] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d36736c462b441088b20cd89c3ea8c27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d36736c462b441088b20cd89c3ea8c27" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45283 } } }
I20260809 06:31:25.487144 31167 sys_catalog.cc:458] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:25.496824 31162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:25.456771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35244 (local address 127.30.78.126:45283)
0809 06:31:25.457644 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:25.457659 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:25.458918 (+ 1259us) server_negotiation.cc:407] Connection header received
0809 06:31:25.468983 (+ 10065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:25.469010 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:25.469486 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:25.469937 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:25.472477 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:25.474403 (+ 1926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:25.476122 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:25.477155 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:25.477320 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:25.484237 (+ 6917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:25.484248 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:25.484266 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:25.484330 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:25.488893 (+ 4563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:25.490131 (+ 1238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:25.490140 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:25.490149 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:25.490367 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:25.490985 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:25.490991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:25.490994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:25.491884 (+ 890us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:25.494661 (+ 2777us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:25.494961 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 06:31:25.495393 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":643,"thread_start_us":379,"threads_started":1}
I20260809 06:31:25.502697 31180 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:31:25.507395 31180 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:31:25.514971 31180 catalog_manager.cc:1347] Generated new cluster ID: 1e4ebac573b4481298ef5b8b38d99e6e
I20260809 06:31:25.515075 31180 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:31:25.536998 31180 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:31:25.538426 31180 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:31:25.543905 31180 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d36736c462b441088b20cd89c3ea8c27: Generated new TSK 0
I20260809 06:31:25.544616 31180 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:31:25.583480 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:45283
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:41701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:25.895896 31199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:25.896169 31199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:25.896273 31199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:25.903644 31199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:25.903752 31199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:25.903879 31199 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:31:25.913264 31199 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:41701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:45283
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:25.914485 31199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:25.915732 31199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:25.928117 31210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:25.928084 31211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:25.928046 31214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:25.929052 31199 server_base.cc:1034] running on GCE node
I20260809 06:31:25.929633 31199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:25.930514 31199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:25.931695 31199 hybrid_clock.cc:648] HybridClock initialized: now 1786257085931645 us; error 46 us; skew 500 ppm
I20260809 06:31:25.931985 31199 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:25 dist-test-slave-cvwc krb5kdc[31042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:25.934995 31199 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:31:25.936319 31199 webserver.cc:460] Webserver started at http://127.30.78.65:44273/ using document root <none> and password file <none>
I20260809 06:31:25.936955 31199 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:25.937067 31199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:25.937361 31199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:25.940269 31199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "049a002cc80640608edc46aaec94669c"
format_stamp: "Formatted at 2026-08-09 06:31:25 on dist-test-slave-cvwc"
server_key: "b71700ec0a4d4e65d186cdc5d047932b"
server_key_iv: "ac13e90f1b1678cc8b985e136ad30dac"
server_key_version: "encryptionkey@0"
I20260809 06:31:25.941018 31199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "049a002cc80640608edc46aaec94669c"
format_stamp: "Formatted at 2026-08-09 06:31:25 on dist-test-slave-cvwc"
server_key: "b71700ec0a4d4e65d186cdc5d047932b"
server_key_iv: "ac13e90f1b1678cc8b985e136ad30dac"
server_key_version: "encryptionkey@0"
I20260809 06:31:25.946090 31199 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260809 06:31:25.949314 31222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:25.950554 31199 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:31:25.950690 31199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "049a002cc80640608edc46aaec94669c"
format_stamp: "Formatted at 2026-08-09 06:31:25 on dist-test-slave-cvwc"
server_key: "b71700ec0a4d4e65d186cdc5d047932b"
server_key_iv: "ac13e90f1b1678cc8b985e136ad30dac"
server_key_version: "encryptionkey@0"
I20260809 06:31:25.950884 31199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:25.984428 31199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:25.988692 31199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:25.988967 31199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:25.989936 31199 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:25.991225 31199 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:25.991297 31199 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:25.991422 31199 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:25.991475 31199 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:26.022269 31199 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:37295
I20260809 06:31:26.022315 31387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:37295 every 8 connection(s)
I20260809 06:31:26.023557 31199 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:31:26.027767 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31199
I20260809 06:31:26.028007 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:31:26.028785 31033 external_mini_cluster.cc:1428] Setting key 9d3d2ac62067644ffbace7effa6db901
Aug 09 06:31:26 dist-test-slave-cvwc krb5kdc[31042](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257085, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
I20260809 06:31:26.046591 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:26.027716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:53695 (local address 127.30.78.126:45283)
0809 06:31:26.029360 (+ 1644us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:26.029364 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:26.029384 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:31:26.030741 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:26.030745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:26.030821 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:26.030943 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:26.033197 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.033941 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.035998 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.036564 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.036681 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:26.040080 (+ 3399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:26.040086 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:26.040091 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:26.040128 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:26.043351 (+ 3223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:26.044007 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:26.044013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:26.044017 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:26.044193 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:26.044676 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:26.044681 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:26.044684 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:26.045063 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:26.045204 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:26.045985 (+ 781us) server_negotiation.cc:299] Negotiation successful
0809 06:31:26.046204 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1537,"thread_start_us":1436,"threads_started":1}
I20260809 06:31:26.047744 31391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:26.027060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:45283 (local address 127.30.78.65:53695)
0809 06:31:26.028218 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:26.028268 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:26.030419 (+ 2151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:26.031453 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:26.031464 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:26.032208 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:26.033000 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:26.033027 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.034096 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.034101 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:26.035866 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:26.035893 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.036751 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.036757 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:26.036954 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:26.037575 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:26.037602 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:26.039862 (+ 2260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:26.043476 (+ 3614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:26.043482 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:26.043495 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:26.043893 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:26.044317 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:26.044320 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:26.044322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:26.044542 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:26.045266 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:26.045271 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:26.045570 (+ 299us) client_negotiation.cc:769] Sending connection context
0809 06:31:26.045912 (+ 342us) client_negotiation.cc:240] Negotiation successful
0809 06:31:26.046416 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":836,"thread_start_us":657,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
I20260809 06:31:26.049458 31389 heartbeater.cc:347] Connected to a master server at 127.30.78.126:45283
I20260809 06:31:26.049844 31389 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:26.050818 31389 heartbeater.cc:511] Master 127.30.78.126:45283 requested a full tablet report, sending...
I20260809 06:31:26.055001 31109 ts_manager.cc:194] Registered new tserver with Master: 049a002cc80640608edc46aaec94669c (127.30.78.65:37295)
I20260809 06:31:26.057080 31109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:53695
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:31:26.074780 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:45283
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:41701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:26.383698 31395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:26.383963 31395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:26.384095 31395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:26.390960 31395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:26.391067 31395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:26.391223 31395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:31:26.400559 31395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:41701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:45283
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:26.401646 31395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:26.402886 31395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:26.414660 31403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:26.414736 31406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:26.414889 31400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:26.415763 31395 server_base.cc:1034] running on GCE node
I20260809 06:31:26.416378 31395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:26.417203 31395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:26.418394 31395 hybrid_clock.cc:648] HybridClock initialized: now 1786257086418334 us; error 46 us; skew 500 ppm
I20260809 06:31:26.418678 31395 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:26 dist-test-slave-cvwc krb5kdc[31042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257086, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:26.421537 31395 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:31:26.422822 31395 webserver.cc:460] Webserver started at http://127.30.78.66:41641/ using document root <none> and password file <none>
I20260809 06:31:26.423425 31395 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:26.423539 31395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:26.423822 31395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:26.426575 31395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "33da3615910a49c59473576b3548b41a"
format_stamp: "Formatted at 2026-08-09 06:31:26 on dist-test-slave-cvwc"
server_key: "2eb86a45b9cb85141b6630b902154ef1"
server_key_iv: "83e682e9e3c0b4fe2d04a1d7ad11e809"
server_key_version: "encryptionkey@0"
I20260809 06:31:26.427354 31395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "33da3615910a49c59473576b3548b41a"
format_stamp: "Formatted at 2026-08-09 06:31:26 on dist-test-slave-cvwc"
server_key: "2eb86a45b9cb85141b6630b902154ef1"
server_key_iv: "83e682e9e3c0b4fe2d04a1d7ad11e809"
server_key_version: "encryptionkey@0"
I20260809 06:31:26.432145 31395 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260809 06:31:26.435278 31414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:26.436435 31395 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:31:26.436594 31395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "33da3615910a49c59473576b3548b41a"
format_stamp: "Formatted at 2026-08-09 06:31:26 on dist-test-slave-cvwc"
server_key: "2eb86a45b9cb85141b6630b902154ef1"
server_key_iv: "83e682e9e3c0b4fe2d04a1d7ad11e809"
server_key_version: "encryptionkey@0"
I20260809 06:31:26.436766 31395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:26.460214 31395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:26.464329 31395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:26.464600 31395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:26.465567 31395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:26.466959 31395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:26.467041 31395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:26.467163 31395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:26.467217 31395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:26.497432 31395 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:43827
I20260809 06:31:26.497473 31574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:43827 every 8 connection(s)
I20260809 06:31:26.498785 31395 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:31:26.507674 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31395
I20260809 06:31:26.507848 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:31:26.508244 31033 external_mini_cluster.cc:1428] Setting key 0492406f93e1af3e314c1a93283f64db
Aug 09 06:31:26 dist-test-slave-cvwc krb5kdc[31042](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257086, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:26.518405 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:26.501320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:39575 (local address 127.30.78.126:45283)
0809 06:31:26.501500 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:26.501504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:26.502700 (+ 1196us) server_negotiation.cc:407] Connection header received
0809 06:31:26.504494 (+ 1794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:26.504500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:26.504577 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:26.504663 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:26.506137 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.506842 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.508472 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.509001 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.509138 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:26.512770 (+ 3632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:26.512776 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:26.512781 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:26.512819 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:26.515569 (+ 2750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:26.516369 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:26.516373 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:26.516375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:26.516521 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:26.516929 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:26.516931 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:26.516933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:26.517159 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:26.517270 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:26.518005 (+ 735us) server_negotiation.cc:299] Negotiation successful
0809 06:31:26.518163 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:31:26.519695 31578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:26.501870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:45283 (local address 127.30.78.66:39575)
0809 06:31:26.502545 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:26.502592 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:26.504233 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:26.504891 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:26.504899 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:26.505393 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:26.505980 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:26.505999 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.507015 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.507019 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:26.508311 (+ 1292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:26.508326 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.509203 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.509208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:26.509477 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:26.510151 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:26.510171 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:26.512552 (+ 2381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:26.515700 (+ 3148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:26.515708 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:26.515723 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:26.516270 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:26.516611 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:26.516616 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:26.516620 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:26.516837 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:26.517272 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:26.517279 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:26.517646 (+ 367us) client_negotiation.cc:769] Sending connection context
0809 06:31:26.517938 (+ 292us) client_negotiation.cc:240] Negotiation successful
0809 06:31:26.518413 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":252,"threads_started":1}
I20260809 06:31:26.520960 31576 heartbeater.cc:347] Connected to a master server at 127.30.78.126:45283
I20260809 06:31:26.521226 31576 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:26.521938 31576 heartbeater.cc:511] Master 127.30.78.126:45283 requested a full tablet report, sending...
I20260809 06:31:26.523234 31109 ts_manager.cc:194] Registered new tserver with Master: 33da3615910a49c59473576b3548b41a (127.30.78.66:43827)
I20260809 06:31:26.524003 31109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:39575
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:31:26.545218 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:45283
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:41701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:26.858043 31584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:26.858304 31584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:26.858440 31584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:26.865553 31584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:26.865656 31584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:26.865846 31584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:31:26.875303 31584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:41701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:45283
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:26.876451 31584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:26.877815 31584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:26.890043 31591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:26.890226 31589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:26.890132 31593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:26.890990 31584 server_base.cc:1034] running on GCE node
I20260809 06:31:26.891533 31584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:26.892396 31584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:26.893589 31584 hybrid_clock.cc:648] HybridClock initialized: now 1786257086893531 us; error 44 us; skew 500 ppm
I20260809 06:31:26.893898 31584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:26 dist-test-slave-cvwc krb5kdc[31042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257086, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:26.896764 31584 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:31:26.898221 31584 webserver.cc:460] Webserver started at http://127.30.78.67:40563/ using document root <none> and password file <none>
I20260809 06:31:26.898836 31584 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:26.898964 31584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:26.899267 31584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:26.902268 31584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "9edc5e647ab446ff906f99513076de29"
format_stamp: "Formatted at 2026-08-09 06:31:26 on dist-test-slave-cvwc"
server_key: "89fea3a474dca62189be559f1e7ede16"
server_key_iv: "96327cd9c82e8bb251e09ea7605ba68e"
server_key_version: "encryptionkey@0"
I20260809 06:31:26.903038 31584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "9edc5e647ab446ff906f99513076de29"
format_stamp: "Formatted at 2026-08-09 06:31:26 on dist-test-slave-cvwc"
server_key: "89fea3a474dca62189be559f1e7ede16"
server_key_iv: "96327cd9c82e8bb251e09ea7605ba68e"
server_key_version: "encryptionkey@0"
I20260809 06:31:26.908103 31584 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:31:26.911414 31604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:26.912623 31584 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:31:26.912771 31584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "9edc5e647ab446ff906f99513076de29"
format_stamp: "Formatted at 2026-08-09 06:31:26 on dist-test-slave-cvwc"
server_key: "89fea3a474dca62189be559f1e7ede16"
server_key_iv: "96327cd9c82e8bb251e09ea7605ba68e"
server_key_version: "encryptionkey@0"
I20260809 06:31:26.912976 31584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:26.937366 31584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:26.941177 31584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:26.941424 31584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:26.942355 31584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:26.943583 31584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:26.943661 31584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:26.943776 31584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:26.943830 31584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:26.974663 31584 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:36279
I20260809 06:31:26.974740 31765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:36279 every 8 connection(s)
I20260809 06:31:26.975847 31584 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:31:26.978422 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31584
I20260809 06:31:26.978607 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:31:26.979023 31033 external_mini_cluster.cc:1428] Setting key a3d4898e5ef68c0ba3947fb53454f43c
Aug 09 06:31:26 dist-test-slave-cvwc krb5kdc[31042](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257086, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:26.994942 31392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:26.978377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:58069 (local address 127.30.78.126:45283)
0809 06:31:26.978595 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:26.978601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:26.979913 (+ 1312us) server_negotiation.cc:407] Connection header received
0809 06:31:26.982226 (+ 2313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:26.982231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:26.982318 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:26.982428 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:26.983858 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.984652 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.986202 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.986613 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.986702 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:26.989791 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:26.989795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:26.989798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:26.989829 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:26.992079 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:26.992769 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:26.992773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:26.992776 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:26.992906 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:26.993304 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:26.993308 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:26.993310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:26.993622 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:26.993783 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:26.994381 (+ 598us) server_negotiation.cc:299] Negotiation successful
0809 06:31:26.994595 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 06:31:26.995755 31772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:26.978915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:45283 (local address 127.30.78.67:58069)
0809 06:31:26.979741 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:26.979796 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:26.981958 (+ 2162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:26.982590 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:26.982597 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:26.983179 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:26.983720 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:26.983737 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.984778 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.984782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:26.986093 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:26.986105 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:26.986783 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:26.986788 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:26.986965 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:26.987508 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:26.987528 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:26.989577 (+ 2049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:26.992221 (+ 2644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:26.992230 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:26.992244 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:26.992659 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:26.993009 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:26.993014 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:26.993018 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:26.993197 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:26.993759 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:26.993766 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:26.994053 (+ 287us) client_negotiation.cc:769] Sending connection context
0809 06:31:26.994281 (+ 228us) client_negotiation.cc:240] Negotiation successful
0809 06:31:26.994744 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":305,"threads_started":1}
I20260809 06:31:26.996881 31766 heartbeater.cc:347] Connected to a master server at 127.30.78.126:45283
I20260809 06:31:26.997157 31766 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:26.997835 31766 heartbeater.cc:511] Master 127.30.78.126:45283 requested a full tablet report, sending...
I20260809 06:31:26.999151 31109 ts_manager.cc:194] Registered new tserver with Master: 9edc5e647ab446ff906f99513076de29 (127.30.78.67:36279)
I20260809 06:31:26.999977 31109 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:58069
I20260809 06:31:27.006593 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:31:27 dist-test-slave-cvwc krb5kdc[31042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257087, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 06:31:27 dist-test-slave-cvwc krb5kdc[31042](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257087, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:31:27.051119 31777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:27.036944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35148 (local address 127.30.78.65:37295)
0809 06:31:27.037499 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:27.037506 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:27.037579 (+ 73us) server_negotiation.cc:407] Connection header received
0809 06:31:27.037770 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:27.037778 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:27.037970 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:27.038094 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:27.039398 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.040456 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.041707 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.042265 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.042359 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:27.046237 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:27.046248 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:27.046260 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:27.046290 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:27.048930 (+ 2640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.049479 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.049485 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.049487 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.049600 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.049956 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.049959 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.049961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.050270 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:27.050508 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:27.050667 (+ 159us) server_negotiation.cc:299] Negotiation successful
0809 06:31:27.050847 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":265,"threads_started":1}
W20260809 06:31:27.052228 31264 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35148
I20260809 06:31:27.060192 31389 heartbeater.cc:503] Master 127.30.78.126:45283 was elected leader, sending a full tablet report...
Aug 09 06:31:27 dist-test-slave-cvwc krb5kdc[31042](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 06:31:27 dist-test-slave-cvwc krb5kdc[31042](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:31:27.091912 31777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:27.079374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35158 (local address 127.30.78.65:37295)
0809 06:31:27.079586 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:27.079592 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:27.079737 (+ 145us) server_negotiation.cc:407] Connection header received
0809 06:31:27.079876 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:27.079880 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:27.079971 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:27.080049 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:27.081347 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.082099 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.083216 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.083600 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.083686 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:27.087455 (+ 3769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:27.087460 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:27.087464 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:27.087495 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:27.089939 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.090452 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.090455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.090457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.090565 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.090817 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.090820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.090822 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.091045 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:27.091213 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:27.091465 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 06:31:27.091620 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:31:27.093304 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31199
I20260809 06:31:27.104748 31777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:27.094118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35160 (local address 127.30.78.65:37295)
0809 06:31:27.094247 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:27.094250 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:27.094575 (+ 325us) server_negotiation.cc:407] Connection header received
0809 06:31:27.094696 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:27.094699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:27.094749 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:27.094813 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:27.095818 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.096455 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.097566 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.098019 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.098105 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:27.100063 (+ 1958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:27.100068 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:27.100071 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:27.100097 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:27.102498 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.103070 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.103074 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.103076 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.103197 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.103514 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.103519 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.103521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.103744 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:27.103948 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:27.104239 (+ 291us) server_negotiation.cc:299] Negotiation successful
0809 06:31:27.104433 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 06:31:27.105312 31379 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:27.185896 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31199
I20260809 06:31:27.207073 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31395
Aug 09 06:31:27 dist-test-slave-cvwc krb5kdc[31042](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:31:27.222270 31789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:27.208153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49544 (local address 127.30.78.66:43827)
0809 06:31:27.208680 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:27.208687 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:27.208711 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:31:27.208771 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:27.208777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:27.209008 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:27.209143 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:27.210375 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.211522 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.212656 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.213177 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.213266 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:27.217210 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:27.217221 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:27.217236 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:27.217277 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:27.219842 (+ 2565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.220390 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.220396 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.220399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.220515 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.220800 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.220803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.220805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.221126 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:27.221343 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:27.221586 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 06:31:27.221940 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":385,"thread_start_us":274,"threads_started":1}
I20260809 06:31:27.223555 31570 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:27.303234 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31395
I20260809 06:31:27.325449 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31584
Aug 09 06:31:27 dist-test-slave-cvwc krb5kdc[31042](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:31:27.340384 31795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:27.326468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45436 (local address 127.30.78.67:36279)
0809 06:31:27.327198 (+ 730us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:27.327205 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:27.327235 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:31:27.327298 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:27.327304 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:27.327515 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:27.327641 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:27.328799 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.329882 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.331056 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:27.331588 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:27.331684 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:27.335473 (+ 3789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:27.335483 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:27.335497 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:27.335527 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:27.338176 (+ 2649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.338733 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.338739 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.338742 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.338851 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:27.339113 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:27.339116 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:27.339118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:27.339437 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:27.339658 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:27.339844 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 06:31:27.340042 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":352,"threads_started":1}
I20260809 06:31:27.341584 31760 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:27.422441 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31584
I20260809 06:31:27.444187 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31064
I20260809 06:31:27.445297 31150 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:27.546387 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31064
2026-08-09T06:31:27Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3880 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:31:27 dist-test-slave-cvwc krb5kdc[31802](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:31:27 dist-test-slave-cvwc krb5kdc[31802](info): set up 2 sockets
Aug 09 06:31:27 dist-test-slave-cvwc krb5kdc[31802](info): commencing operation
krb5kdc: starting...
W20260809 06:31:28.710515 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.005s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:31:28 dist-test-slave-cvwc krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:31:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:31:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:31:28.886425 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:44999
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:44999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:29.191609 31820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:29.191884 31820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:29.191980 31820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:29.198868 31820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:31:29.198969 31820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:29.199020 31820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:29.199076 31820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:31:29.199119 31820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:31:29.208564 31820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:44999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:44999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:29.209794 31820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:29.211042 31820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:29.222011 31826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:29.222045 31828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:29.221985 31825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:29.223143 31820 server_base.cc:1034] running on GCE node
I20260809 06:31:29.223888 31820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:29.225190 31820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:29.226395 31820 hybrid_clock.cc:648] HybridClock initialized: now 1786257089226340 us; error 31 us; skew 500 ppm
I20260809 06:31:29.226707 31820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:29 dist-test-slave-cvwc krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257089, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:29.229583 31820 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:31:29.230933 31820 webserver.cc:460] Webserver started at http://127.30.78.126:38645/ using document root <none> and password file <none>
I20260809 06:31:29.231575 31820 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:29.231689 31820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:29.231979 31820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:29.234969 31820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "8e9414f5bb7949a3ad0adb33a9da555e"
format_stamp: "Formatted at 2026-08-09 06:31:29 on dist-test-slave-cvwc"
server_key: "90a5b4b08474fbbeb1b898a59cc1f681"
server_key_iv: "42ad7c4a1fa599217d88943f6fe5adca"
server_key_version: "encryptionkey@0"
I20260809 06:31:29.235788 31820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "8e9414f5bb7949a3ad0adb33a9da555e"
format_stamp: "Formatted at 2026-08-09 06:31:29 on dist-test-slave-cvwc"
server_key: "90a5b4b08474fbbeb1b898a59cc1f681"
server_key_iv: "42ad7c4a1fa599217d88943f6fe5adca"
server_key_version: "encryptionkey@0"
I20260809 06:31:29.240690 31820 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 06:31:29.243901 31841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:29.245055 31820 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:31:29.245213 31820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "8e9414f5bb7949a3ad0adb33a9da555e"
format_stamp: "Formatted at 2026-08-09 06:31:29 on dist-test-slave-cvwc"
server_key: "90a5b4b08474fbbeb1b898a59cc1f681"
server_key_iv: "42ad7c4a1fa599217d88943f6fe5adca"
server_key_version: "encryptionkey@0"
I20260809 06:31:29.245388 31820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:29.275611 31820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:29.279506 31820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:29.279767 31820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:29.296286 31820 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:44999
I20260809 06:31:29.296306 31917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:44999 every 8 connection(s)
I20260809 06:31:29.297581 31820 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:31:29.298377 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31820
I20260809 06:31:29.298637 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:31:29.299306 31033 external_mini_cluster.cc:1428] Setting key ba8f9e9aae5ed1949b92b28fb6ebdcab
I20260809 06:31:29.301761 31919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:31:29 dist-test-slave-cvwc krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:29.311724 31919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e: Bootstrap starting.
I20260809 06:31:29.315117 31919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:29.316144 31919 log.cc:824] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:29.319209 31919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e: No bootstrap required, opened a new log
I20260809 06:31:29.319960 31923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:29.301155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50498 (local address 127.30.78.126:44999)
0809 06:31:29.301939 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:29.301951 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:29.301992 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:31:29.303578 (+ 1586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:29.303598 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:29.303958 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:29.304312 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:29.305762 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:29.307069 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:29.308244 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:29.308883 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:29.309055 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:29.312999 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:29.313007 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:29.313019 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:29.313052 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:29.315971 (+ 2919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:29.316749 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:29.316758 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:29.316767 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:29.316985 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:29.317327 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:29.317332 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:29.317335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:29.317880 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:29.318076 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:29.318612 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 06:31:29.318911 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":318,"threads_started":1}
I20260809 06:31:29.326995 31919 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e9414f5bb7949a3ad0adb33a9da555e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44999 } }
I20260809 06:31:29.327312 31919 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:29.327409 31919 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e9414f5bb7949a3ad0adb33a9da555e, State: Initialized, Role: FOLLOWER
I20260809 06:31:29.327893 31919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e9414f5bb7949a3ad0adb33a9da555e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44999 } }
I20260809 06:31:29.328096 31919 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:31:29.328217 31919 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:31:29.328366 31919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:29.330371 31919 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e9414f5bb7949a3ad0adb33a9da555e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44999 } }
I20260809 06:31:29.330816 31919 leader_election.cc:302] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e9414f5bb7949a3ad0adb33a9da555e; no voters:
I20260809 06:31:29.331324 31919 leader_election.cc:288] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:31:29.331420 31928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:29.332036 31928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [term 1 LEADER]: Becoming Leader. State: Replica: 8e9414f5bb7949a3ad0adb33a9da555e, State: Running, Role: LEADER
I20260809 06:31:29.332494 31928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e9414f5bb7949a3ad0adb33a9da555e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44999 } }
I20260809 06:31:29.333117 31919 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:31:29.335259 31930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e9414f5bb7949a3ad0adb33a9da555e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e9414f5bb7949a3ad0adb33a9da555e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44999 } } }
I20260809 06:31:29.335350 31931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e9414f5bb7949a3ad0adb33a9da555e. Latest consensus state: current_term: 1 leader_uuid: "8e9414f5bb7949a3ad0adb33a9da555e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e9414f5bb7949a3ad0adb33a9da555e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44999 } } }
I20260809 06:31:29.335722 31930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:29.335747 31931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:29.338179 31938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:31:29.343099 31938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:31:29.351598 31938 catalog_manager.cc:1347] Generated new cluster ID: 875f5815beba4e178d635cc83f28c7fe
I20260809 06:31:29.351687 31938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:31:29.371454 31938 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:31:29.372762 31938 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:31:29.380115 31938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8e9414f5bb7949a3ad0adb33a9da555e: Generated new TSK 0
I20260809 06:31:29.380879 31938 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:31:29.427119 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44999
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:29.760447 31960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:29.760717 31960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:29.760854 31960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:29.767995 31960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:29.768108 31960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:29.768275 31960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:31:29.777755 31960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44999
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:29.779011 31960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:29.780296 31960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:29.792352 31971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:29.792510 31975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:29.792532 31970 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:29.793354 31960 server_base.cc:1034] running on GCE node
I20260809 06:31:29.793973 31960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:29.794808 31960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:29.795994 31960 hybrid_clock.cc:648] HybridClock initialized: now 1786257089795949 us; error 35 us; skew 500 ppm
I20260809 06:31:29.796273 31960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:29 dist-test-slave-cvwc krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257089, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:29.799394 31960 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:31:29.800720 31960 webserver.cc:460] Webserver started at http://127.30.78.65:36795/ using document root <none> and password file <none>
I20260809 06:31:29.801362 31960 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:29.801486 31960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:29.801812 31960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:29.804569 31960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "856a676637ab46a5a014aaedc103f5fd"
format_stamp: "Formatted at 2026-08-09 06:31:29 on dist-test-slave-cvwc"
server_key: "70a04e0ed88ee3279dc974bc0549f3ab"
server_key_iv: "99c5de99958da202b9c4d2e799c9c387"
server_key_version: "encryptionkey@0"
I20260809 06:31:29.805310 31960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "856a676637ab46a5a014aaedc103f5fd"
format_stamp: "Formatted at 2026-08-09 06:31:29 on dist-test-slave-cvwc"
server_key: "70a04e0ed88ee3279dc974bc0549f3ab"
server_key_iv: "99c5de99958da202b9c4d2e799c9c387"
server_key_version: "encryptionkey@0"
I20260809 06:31:29.810174 31960 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:31:29.813326 31987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:29.814538 31960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:31:29.814684 31960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "856a676637ab46a5a014aaedc103f5fd"
format_stamp: "Formatted at 2026-08-09 06:31:29 on dist-test-slave-cvwc"
server_key: "70a04e0ed88ee3279dc974bc0549f3ab"
server_key_iv: "99c5de99958da202b9c4d2e799c9c387"
server_key_version: "encryptionkey@0"
I20260809 06:31:29.814854 31960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:29.853041 31960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:29.857118 31960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:29.857399 31960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:29.858350 31960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:29.859630 31960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:29.859707 31960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:29.859824 31960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:29.859882 31960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:29.897075 31960 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:33165
I20260809 06:31:29.897143 32178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:33165 every 8 connection(s)
I20260809 06:31:29.898329 31960 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:31:29.903492 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31960
I20260809 06:31:29.903704 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:31:29.904451 31033 external_mini_cluster.cc:1428] Setting key 5a8a6424f2a4c90db7e35e962f63d981
Aug 09 06:31:29 dist-test-slave-cvwc krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257089, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:29.919610 32183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:29.900721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:34585 (local address 127.30.78.126:44999)
0809 06:31:29.901147 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:29.901151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:29.901988 (+ 837us) server_negotiation.cc:407] Connection header received
0809 06:31:29.904095 (+ 2107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:29.904100 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:29.904170 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:29.904262 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:29.906130 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:29.906945 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:29.909122 (+ 2177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:29.909496 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:29.909588 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:29.913475 (+ 3887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:29.913482 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:29.913487 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:29.913528 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:29.916493 (+ 2965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:29.917169 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:29.917175 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:29.917178 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:29.917317 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:29.917746 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:29.917750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:29.917753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:29.918080 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:29.918242 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:29.919002 (+ 760us) server_negotiation.cc:299] Negotiation successful
0809 06:31:29.919229 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":217,"threads_started":1}
I20260809 06:31:29.920593 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:29.901148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:44999 (local address 127.30.78.65:34585)
0809 06:31:29.901831 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:29.901875 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:29.903790 (+ 1915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:29.904531 (+ 741us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:29.904543 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:29.905197 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:29.905973 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:29.905992 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:29.907114 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:29.907119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:29.908987 (+ 1868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:29.909002 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:29.909707 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:29.909742 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:29.910004 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:29.910670 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:29.910696 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:29.913246 (+ 2550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:29.916621 (+ 3375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:29.916628 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:29.916640 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:29.917041 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:29.917412 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:29.917414 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:29.917417 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:29.917611 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:29.918211 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:29.918217 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:29.918590 (+ 373us) client_negotiation.cc:769] Sending connection context
0809 06:31:29.918871 (+ 281us) client_negotiation.cc:240] Negotiation successful
0809 06:31:29.919333 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":258,"threads_started":1}
I20260809 06:31:29.922103 32179 heartbeater.cc:347] Connected to a master server at 127.30.78.126:44999
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
I20260809 06:31:29.922416 32179 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:29.923110 32179 heartbeater.cc:511] Master 127.30.78.126:44999 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
I20260809 06:31:29.925122 31862 ts_manager.cc:194] Registered new tserver with Master: 856a676637ab46a5a014aaedc103f5fd (127.30.78.65:33165)
I20260809 06:31:29.927100 31862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:34585
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:31:29.944505 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44999
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:30.251255 32188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:30.251549 32188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:30.251698 32188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:30.258821 32188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:30.258942 32188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:30.259097 32188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:31:30.268504 32188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44999
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:30.269737 32188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:30.270995 32188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:30.283527 32199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:30.283558 32195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:30.284097 32196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:30.284233 32188 server_base.cc:1034] running on GCE node
I20260809 06:31:30.284858 32188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:30.285703 32188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:30.286926 32188 hybrid_clock.cc:648] HybridClock initialized: now 1786257090286881 us; error 38 us; skew 500 ppm
I20260809 06:31:30.287211 32188 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:30 dist-test-slave-cvwc krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257090, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:30.290161 32188 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:31:30.291479 32188 webserver.cc:460] Webserver started at http://127.30.78.66:35959/ using document root <none> and password file <none>
I20260809 06:31:30.292101 32188 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:30.292215 32188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:30.292510 32188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:30.295291 32188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "6deadee1a96047da8b43be42a41f5117"
format_stamp: "Formatted at 2026-08-09 06:31:30 on dist-test-slave-cvwc"
server_key: "b87d1c5dc1e132d34c4e81b3aacbff5e"
server_key_iv: "4f0c55fdd2b17c1ecb0787b0b41b5e2e"
server_key_version: "encryptionkey@0"
I20260809 06:31:30.296072 32188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "6deadee1a96047da8b43be42a41f5117"
format_stamp: "Formatted at 2026-08-09 06:31:30 on dist-test-slave-cvwc"
server_key: "b87d1c5dc1e132d34c4e81b3aacbff5e"
server_key_iv: "4f0c55fdd2b17c1ecb0787b0b41b5e2e"
server_key_version: "encryptionkey@0"
I20260809 06:31:30.301081 32188 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 06:31:30.304587 32211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:30.305984 32188 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:31:30.306137 32188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "6deadee1a96047da8b43be42a41f5117"
format_stamp: "Formatted at 2026-08-09 06:31:30 on dist-test-slave-cvwc"
server_key: "b87d1c5dc1e132d34c4e81b3aacbff5e"
server_key_iv: "4f0c55fdd2b17c1ecb0787b0b41b5e2e"
server_key_version: "encryptionkey@0"
I20260809 06:31:30.306348 32188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:30.316530 32188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:30.320209 32188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:30.320427 32188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:30.321233 32188 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:30.322477 32188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:30.322548 32188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:30.322634 32188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:30.322677 32188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:30.351797 32188 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:46837
I20260809 06:31:30.351822 32389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:46837 every 8 connection(s)
I20260809 06:31:30.353029 32188 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:31:30.357980 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 32188
I20260809 06:31:30.358166 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:31:30.358727 31033 external_mini_cluster.cc:1428] Setting key 92573677ebcb18f96664ab9980e1d574
Aug 09 06:31:30 dist-test-slave-cvwc krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257090, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:30.373558 32183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.355377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:41503 (local address 127.30.78.126:44999)
0809 06:31:30.355579 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:30.355586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:30.356756 (+ 1170us) server_negotiation.cc:407] Connection header received
0809 06:31:30.358863 (+ 2107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:30.358869 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:30.358962 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:30.359047 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:30.360671 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.361370 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.363489 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.363898 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.363995 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.367472 (+ 3477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:30.367478 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:30.367483 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:30.367522 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:30.370531 (+ 3009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:30.371187 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:30.371193 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:30.371196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:30.371353 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:30.371738 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:30.371743 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:30.371746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:30.372104 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:30.372265 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:30.372963 (+ 698us) server_negotiation.cc:299] Negotiation successful
0809 06:31:30.373201 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:31:30.374264 32395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.355907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:44999 (local address 127.30.78.66:41503)
0809 06:31:30.356578 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:30.356615 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:30.358569 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:30.359306 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:30.359318 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:30.359912 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:30.360519 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.360539 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.361518 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.361523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.363344 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.363361 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.364112 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.364119 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.364377 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.365025 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:30.365050 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:30.367253 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:30.370652 (+ 3399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:30.370658 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:30.370670 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:30.371059 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:30.371451 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:30.371454 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:30.371457 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:30.371623 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:30.372230 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:30.372236 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:30.372578 (+ 342us) client_negotiation.cc:769] Sending connection context
0809 06:31:30.372791 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 06:31:30.373166 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":260,"threads_started":1}
I20260809 06:31:30.375649 32390 heartbeater.cc:347] Connected to a master server at 127.30.78.126:44999
I20260809 06:31:30.375934 32390 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
I20260809 06:31:30.376606 32390 heartbeater.cc:511] Master 127.30.78.126:44999 requested a full tablet report, sending...
I20260809 06:31:30.378057 31862 ts_manager.cc:194] Registered new tserver with Master: 6deadee1a96047da8b43be42a41f5117 (127.30.78.66:46837)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
I20260809 06:31:30.379034 31862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:41503
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:31:30.396369 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44999
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:30.703728 32399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:30.704015 32399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:30.704160 32399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:30.711277 32399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:30.711392 32399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:30.711552 32399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:31:30.721031 32399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44999
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:30.722271 32399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:30.723536 32399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:30.741497 32409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:30.741679 32407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:30.741824 32412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:30.742529 32399 server_base.cc:1034] running on GCE node
I20260809 06:31:30.743101 32399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:30.743971 32399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:30.745157 32399 hybrid_clock.cc:648] HybridClock initialized: now 1786257090745100 us; error 52 us; skew 500 ppm
I20260809 06:31:30.745445 32399 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:30 dist-test-slave-cvwc krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257090, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:30.748380 32399 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:31:30.749817 32399 webserver.cc:460] Webserver started at http://127.30.78.67:36543/ using document root <none> and password file <none>
I20260809 06:31:30.750452 32399 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:30.750561 32399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:30.750842 32399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:30.753618 32399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "31ad3b1c60e94c5c91ebc246818af8a5"
format_stamp: "Formatted at 2026-08-09 06:31:30 on dist-test-slave-cvwc"
server_key: "ec915381021adfb834ae6a410e914fd6"
server_key_iv: "48534864e57bd5e1a289e2a4dc4834e4"
server_key_version: "encryptionkey@0"
I20260809 06:31:30.754434 32399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "31ad3b1c60e94c5c91ebc246818af8a5"
format_stamp: "Formatted at 2026-08-09 06:31:30 on dist-test-slave-cvwc"
server_key: "ec915381021adfb834ae6a410e914fd6"
server_key_iv: "48534864e57bd5e1a289e2a4dc4834e4"
server_key_version: "encryptionkey@0"
I20260809 06:31:30.759240 32399 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:31:30.762542 32420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:30.763729 32399 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:31:30.763873 32399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "31ad3b1c60e94c5c91ebc246818af8a5"
format_stamp: "Formatted at 2026-08-09 06:31:30 on dist-test-slave-cvwc"
server_key: "ec915381021adfb834ae6a410e914fd6"
server_key_iv: "48534864e57bd5e1a289e2a4dc4834e4"
server_key_version: "encryptionkey@0"
I20260809 06:31:30.764057 32399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:30.799417 32399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:30.803228 32399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:30.803514 32399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:30.804430 32399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:30.805706 32399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:30.805815 32399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:30.805933 32399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:30.805986 32399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:30.836397 32399 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:38307
I20260809 06:31:30.836450 32592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:38307 every 8 connection(s)
I20260809 06:31:30.837705 32399 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:31:30.839097 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 32399
I20260809 06:31:30.839280 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:31:30.839730 31033 external_mini_cluster.cc:1428] Setting key c6bb79ab2830f5921e84406b24bb65fc
Aug 09 06:31:30 dist-test-slave-cvwc krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257090, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:30.858282 32183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.840310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:55693 (local address 127.30.78.126:44999)
0809 06:31:30.840491 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:30.840497 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:30.841911 (+ 1414us) server_negotiation.cc:407] Connection header received
0809 06:31:30.843764 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:30.843768 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:30.843835 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:30.843917 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:30.845396 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.846558 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.848779 (+ 2221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.849321 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.849441 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.853070 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:30.853075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:30.853079 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:30.853111 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:30.855809 (+ 2698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:30.856449 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:30.856452 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:30.856455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:30.856566 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:30.856890 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:30.856893 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:30.856894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:30.857135 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:30.857240 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:30.857876 (+ 636us) server_negotiation.cc:299] Negotiation successful
0809 06:31:30.858034 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:31:30.859248 32599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.840926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:44999 (local address 127.30.78.67:55693)
0809 06:31:30.841754 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:30.841801 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:30.843538 (+ 1737us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:30.844106 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:30.844114 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:30.844616 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:30.845210 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.845233 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.846701 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.846706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.848589 (+ 1883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.848603 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.849563 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.849571 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.849911 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.850642 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:30.850670 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:30.852871 (+ 2201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:30.855938 (+ 3067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:30.855945 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:30.855957 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:30.856352 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:30.856638 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:30.856641 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:30.856643 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:30.856815 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:30.857226 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:30.857232 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:30.857526 (+ 294us) client_negotiation.cc:769] Sending connection context
0809 06:31:30.857794 (+ 268us) client_negotiation.cc:240] Negotiation successful
0809 06:31:30.858172 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":320,"threads_started":1}
I20260809 06:31:30.860477 32593 heartbeater.cc:347] Connected to a master server at 127.30.78.126:44999
I20260809 06:31:30.860754 32593 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:30.861449 32593 heartbeater.cc:511] Master 127.30.78.126:44999 requested a full tablet report, sending...
I20260809 06:31:30.862785 31862 ts_manager.cc:194] Registered new tserver with Master: 31ad3b1c60e94c5c91ebc246818af8a5 (127.30.78.67:38307)
I20260809 06:31:30.863528 31862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:55693
I20260809 06:31:30.866609 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:31:30.884059 32183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.872463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50502 (local address 127.30.78.126:44999)
0809 06:31:30.872637 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:30.872643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:30.873144 (+ 501us) server_negotiation.cc:407] Connection header received
0809 06:31:30.873266 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:30.873270 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:30.873327 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:30.873411 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:30.874830 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.875543 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.876795 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.877169 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.877275 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.879444 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:30.879449 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:30.879452 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:30.879483 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:30.881647 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:30.882257 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:30.882262 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:30.882266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:30.882400 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:30.882738 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:30.882742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:30.882746 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:30.883033 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:30.883263 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:30.883565 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 06:31:30.883770 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:31:30.889528 31862 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50502:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:31:30.896173 31862 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:31:30.917450 32610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.907846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:46837 (local address 127.0.0.1:33106)
0809 06:31:30.908744 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:30.908793 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:30.908959 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:30.910926 (+ 1967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:30.910935 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:30.910971 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:30.911616 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.911629 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.913375 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.913383 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.915015 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.915034 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.916510 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.916517 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.916722 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.916775 (+ 53us) client_negotiation.cc:769] Sending connection context
0809 06:31:30.916921 (+ 146us) client_negotiation.cc:240] Negotiation successful
0809 06:31:30.917092 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":462,"threads_started":1}
I20260809 06:31:30.917462 32615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.908090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33106 (local address 127.30.78.66:46837)
0809 06:31:30.910257 (+ 2167us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:30.910266 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:30.910295 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:31:30.910412 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:30.910420 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:30.910674 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:30.911151 (+ 477us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:30.911795 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.913235 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.915207 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.916318 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.916433 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.916566 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:30.916965 (+ 399us) server_negotiation.cc:299] Negotiation successful
0809 06:31:30.917134 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2006,"thread_start_us":1877,"threads_started":1}
I20260809 06:31:30.919785 32612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.909111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:33165 (local address 127.0.0.1:51118)
0809 06:31:30.912218 (+ 3107us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:30.912231 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:30.912335 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:30.913098 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:30.913101 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:30.913120 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:30.913398 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.913409 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.915220 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.915225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.916963 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.916976 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.919032 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.919040 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.919203 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.919236 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:31:30.919322 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 06:31:30.919465 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2996,"thread_start_us":1615,"threads_started":1}
I20260809 06:31:30.920300 32618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.908669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32772 (local address 127.30.78.67:38307)
0809 06:31:30.909805 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:30.909814 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:30.911106 (+ 1292us) server_negotiation.cc:407] Connection header received
0809 06:31:30.911449 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:30.911457 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:30.911669 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:30.911825 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:30.913095 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.914599 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.917845 (+ 3246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.919295 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.919419 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.919623 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:30.919818 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 06:31:30.919979 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":937,"thread_start_us":755,"threads_started":1}
I20260809 06:31:30.920584 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.909677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51118 (local address 127.30.78.65:33165)
0809 06:31:30.910588 (+ 911us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:30.910597 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:30.912324 (+ 1727us) server_negotiation.cc:407] Connection header received
0809 06:31:30.912479 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:30.912485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:30.912695 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:30.912872 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:30.913604 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.915061 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.917127 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.918547 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.918672 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.918886 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:30.920086 (+ 1200us) server_negotiation.cc:299] Negotiation successful
0809 06:31:30.920240 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":753,"thread_start_us":642,"threads_started":1}
I20260809 06:31:30.920269 32620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:30.908023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:38307 (local address 127.0.0.1:32772)
0809 06:31:30.910998 (+ 2975us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:30.911019 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:30.911215 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:30.912457 (+ 1242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:30.912461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:30.912483 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:30.912916 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.912932 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.914733 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.914739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.917675 (+ 2936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:30.917690 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:30.919480 (+ 1790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:30.919487 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:30.919660 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:30.919691 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 06:31:30.919766 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 06:31:30.919894 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2855,"mutex_wait_us":948,"thread_start_us":3977,"threads_started":1}
I20260809 06:31:30.921888 32288 tablet_service.cc:1467] Processing CreateTablet for tablet 9fde65e06d934bafbed2fb6137f56fa2 (DEFAULT_TABLE table=test-table [id=7120332865884313a991761886f2c038]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:30.923228 32288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fde65e06d934bafbed2fb6137f56fa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:30.924091 32499 tablet_service.cc:1467] Processing CreateTablet for tablet 9fde65e06d934bafbed2fb6137f56fa2 (DEFAULT_TABLE table=test-table [id=7120332865884313a991761886f2c038]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:30.924091 32069 tablet_service.cc:1467] Processing CreateTablet for tablet 9fde65e06d934bafbed2fb6137f56fa2 (DEFAULT_TABLE table=test-table [id=7120332865884313a991761886f2c038]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:30.925463 32499 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fde65e06d934bafbed2fb6137f56fa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:30.925469 32069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fde65e06d934bafbed2fb6137f56fa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:30.929932 32179 heartbeater.cc:503] Master 127.30.78.126:44999 was elected leader, sending a full tablet report...
I20260809 06:31:30.934867 32623 tablet_bootstrap.cc:492] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117: Bootstrap starting.
I20260809 06:31:30.937999 32623 tablet_bootstrap.cc:654] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:30.939206 32624 tablet_bootstrap.cc:492] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5: Bootstrap starting.
I20260809 06:31:30.939211 32623 log.cc:824] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:30.942299 32624 tablet_bootstrap.cc:654] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:30.942427 32623 tablet_bootstrap.cc:492] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117: No bootstrap required, opened a new log
I20260809 06:31:30.942788 32623 ts_tablet_manager.cc:1397] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 06:31:30.943046 32627 tablet_bootstrap.cc:492] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd: Bootstrap starting.
I20260809 06:31:30.943509 32624 log.cc:824] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:30.946249 32627 tablet_bootstrap.cc:654] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:30.946547 32624 tablet_bootstrap.cc:492] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5: No bootstrap required, opened a new log
I20260809 06:31:30.946805 32624 ts_tablet_manager.cc:1397] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s
I20260809 06:31:30.947451 32627 log.cc:824] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:30.950397 32627 tablet_bootstrap.cc:492] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd: No bootstrap required, opened a new log
I20260809 06:31:30.950652 32627 ts_tablet_manager.cc:1397] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 06:31:30.951244 32623 raft_consensus.cc:348] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } }
I20260809 06:31:30.951671 32623 raft_consensus.cc:374] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:30.951783 32623 raft_consensus.cc:729] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6deadee1a96047da8b43be42a41f5117, State: Initialized, Role: FOLLOWER
I20260809 06:31:30.952387 32623 consensus_queue.cc:260] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } }
I20260809 06:31:30.953466 32390 heartbeater.cc:503] Master 127.30.78.126:44999 was elected leader, sending a full tablet report...
I20260809 06:31:30.954052 32623 ts_tablet_manager.cc:1428] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s
I20260809 06:31:30.955297 32624 raft_consensus.cc:348] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } }
I20260809 06:31:30.955602 32624 raft_consensus.cc:374] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:30.955703 32624 raft_consensus.cc:729] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ad3b1c60e94c5c91ebc246818af8a5, State: Initialized, Role: FOLLOWER
I20260809 06:31:30.956209 32624 consensus_queue.cc:260] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } }
I20260809 06:31:30.957156 32593 heartbeater.cc:503] Master 127.30.78.126:44999 was elected leader, sending a full tablet report...
I20260809 06:31:30.957787 32624 ts_tablet_manager.cc:1428] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5: Time spent starting tablet: real 0.011s user 0.009s sys 0.003s
I20260809 06:31:30.959595 32627 raft_consensus.cc:348] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } }
I20260809 06:31:30.960041 32627 raft_consensus.cc:374] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:30.960160 32627 raft_consensus.cc:729] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 856a676637ab46a5a014aaedc103f5fd, State: Initialized, Role: FOLLOWER
I20260809 06:31:30.960647 32627 consensus_queue.cc:260] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } }
I20260809 06:31:30.962100 32627 ts_tablet_manager.cc:1428] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260809 06:31:31.007958 32635 raft_consensus.cc:482] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:31.008226 32635 raft_consensus.cc:504] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } }
I20260809 06:31:31.009996 32635 leader_election.cc:288] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6deadee1a96047da8b43be42a41f5117 (127.30.78.66:46837), 856a676637ab46a5a014aaedc103f5fd (127.30.78.65:33165)
I20260809 06:31:31.016291 32615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.010383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:60235 (local address 127.30.78.66:46837)
0809 06:31:31.010617 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:31.010622 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:31.010643 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:31:31.010732 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:31.010738 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:31.010810 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:31.010910 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:31.011362 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.012373 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.014399 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.015557 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.015691 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.015751 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:31.016020 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 06:31:31.016105 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 06:31:31.016422 32599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.010280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:46837 (local address 127.30.78.67:60235)
0809 06:31:31.010486 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:31.010507 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:31.010622 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:31.010940 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:31.010945 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:31.010980 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:31.011198 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:31.011214 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.012519 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.012524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:31.014239 (+ 1715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:31.014251 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.015686 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.015691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:31.015873 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.015910 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:31:31.016006 (+ 96us) client_negotiation.cc:240] Negotiation successful
0809 06:31:31.016136 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57,"mutex_wait_us":1}
I20260809 06:31:31.017515 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.010921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:42461 (local address 127.30.78.65:33165)
0809 06:31:31.011107 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:31.011111 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:31.011658 (+ 547us) server_negotiation.cc:407] Connection header received
0809 06:31:31.011803 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:31.011807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:31.011862 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:31.011936 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:31.012510 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.013559 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.015686 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.016796 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.016960 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.017025 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:31.017267 (+ 242us) server_negotiation.cc:299] Negotiation successful
0809 06:31:31.017350 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:31:31.017683 32637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.010784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:33165 (local address 127.30.78.67:42461)
0809 06:31:31.011554 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:31.011571 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:31.011694 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:31.011968 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:31.011973 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:31.011997 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:31.012378 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:31.012389 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.013695 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.013699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:31.015521 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:31.015537 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.016973 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.016978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:31.017123 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.017156 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:31:31.017254 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 06:31:31.017375 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":450,"threads_started":1}
I20260809 06:31:31.017546 32323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fde65e06d934bafbed2fb6137f56fa2" candidate_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6deadee1a96047da8b43be42a41f5117" is_pre_election: true
I20260809 06:31:31.018085 32323 raft_consensus.cc:2454] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ad3b1c60e94c5c91ebc246818af8a5 in term 0.
I20260809 06:31:31.018642 32106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fde65e06d934bafbed2fb6137f56fa2" candidate_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "856a676637ab46a5a014aaedc103f5fd" is_pre_election: true
I20260809 06:31:31.018755 32423 leader_election.cc:302] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ad3b1c60e94c5c91ebc246818af8a5, 6deadee1a96047da8b43be42a41f5117; no voters:
I20260809 06:31:31.019158 32635 raft_consensus.cc:2781] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:31.019134 32106 raft_consensus.cc:2454] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ad3b1c60e94c5c91ebc246818af8a5 in term 0.
I20260809 06:31:31.019308 32635 raft_consensus.cc:482] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:31.019423 32635 raft_consensus.cc:3037] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:31.021656 32635 raft_consensus.cc:504] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } }
I20260809 06:31:31.022229 32635 leader_election.cc:288] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6deadee1a96047da8b43be42a41f5117 (127.30.78.66:46837), 856a676637ab46a5a014aaedc103f5fd (127.30.78.65:33165)
I20260809 06:31:31.022600 32323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fde65e06d934bafbed2fb6137f56fa2" candidate_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6deadee1a96047da8b43be42a41f5117"
I20260809 06:31:31.022687 32106 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fde65e06d934bafbed2fb6137f56fa2" candidate_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "856a676637ab46a5a014aaedc103f5fd"
I20260809 06:31:31.022799 32323 raft_consensus.cc:3037] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:31.022867 32106 raft_consensus.cc:3037] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:31.025951 32323 raft_consensus.cc:2454] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ad3b1c60e94c5c91ebc246818af8a5 in term 1.
I20260809 06:31:31.025959 32106 raft_consensus.cc:2454] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ad3b1c60e94c5c91ebc246818af8a5 in term 1.
I20260809 06:31:31.026292 32423 leader_election.cc:302] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ad3b1c60e94c5c91ebc246818af8a5, 856a676637ab46a5a014aaedc103f5fd; no voters:
I20260809 06:31:31.026546 32635 raft_consensus.cc:2781] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:31.026962 32635 raft_consensus.cc:686] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [term 1 LEADER]: Becoming Leader. State: Replica: 31ad3b1c60e94c5c91ebc246818af8a5, State: Running, Role: LEADER
I20260809 06:31:31.027377 32635 consensus_queue.cc:237] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } }
I20260809 06:31:31.031595 31861 catalog_manager.cc:5495] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31ad3b1c60e94c5c91ebc246818af8a5 (127.30.78.67). New cstate: current_term: 1 leader_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6deadee1a96047da8b43be42a41f5117" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ad3b1c60e94c5c91ebc246818af8a5" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "856a676637ab46a5a014aaedc103f5fd" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33165 } health_report { overall_health: UNKNOWN } } }
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:31:31.076813 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.063242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51124 (local address 127.30.78.65:33165)
0809 06:31:31.063485 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:31.063492 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:31.063844 (+ 352us) server_negotiation.cc:407] Connection header received
0809 06:31:31.063978 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:31.063982 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:31.064058 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:31.064142 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:31.065576 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.066368 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.067560 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.067967 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.068058 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.071971 (+ 3913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:31.071984 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:31.071999 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:31.072034 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:31.074615 (+ 2581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.075165 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.075172 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.075174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.075298 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.075564 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.075566 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.075568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.075903 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:31.076120 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:31.076307 (+ 187us) server_negotiation.cc:299] Negotiation successful
0809 06:31:31.076473 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260809 06:31:31.089361 32598 tablet.cc:2369] T 9fde65e06d934bafbed2fb6137f56fa2 P 31ad3b1c60e94c5c91ebc246818af8a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257091, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
W20260809 06:31:31.104894 32393 tablet.cc:2369] T 9fde65e06d934bafbed2fb6137f56fa2 P 6deadee1a96047da8b43be42a41f5117: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257091, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:31:31.119745 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.106768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51140 (local address 127.30.78.65:33165)
0809 06:31:31.106968 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:31.106974 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:31.107266 (+ 292us) server_negotiation.cc:407] Connection header received
0809 06:31:31.107423 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:31.107429 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:31.107513 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:31.107605 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:31.108806 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.109606 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.110899 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.111300 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.111400 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.114794 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:31.114798 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:31.114801 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:31.114831 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:31.117276 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.117873 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.117877 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.117879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.118036 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.118413 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.118416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.118418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.118677 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:31.118935 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:31.119227 (+ 292us) server_negotiation.cc:299] Negotiation successful
0809 06:31:31.119448 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[31802](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260809 06:31:31.150614 32181 tablet.cc:2369] T 9fde65e06d934bafbed2fb6137f56fa2 P 856a676637ab46a5a014aaedc103f5fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:31:31.158718 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.146519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51142 (local address 127.30.78.65:33165)
0809 06:31:31.146725 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:31.146731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:31.146868 (+ 137us) server_negotiation.cc:407] Connection header received
0809 06:31:31.147019 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:31.147022 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:31.147084 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:31.147153 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:31.148357 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.149016 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.150222 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.150842 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.150958 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.154399 (+ 3441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:31.154404 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:31.154407 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:31.154445 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:31.156608 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.157158 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.157162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.157164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.157350 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.157602 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.157605 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.157607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.157913 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:31.158097 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:31.158285 (+ 188us) server_negotiation.cc:299] Negotiation successful
0809 06:31:31.158449 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260809 06:31:31.160423 32038 tablet_service.cc:2908] Rejecting scan request for tablet 9fde65e06d934bafbed2fb6137f56fa2: Uninitialized: clean time has not yet been initialized
I20260809 06:31:31.163584 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31960
I20260809 06:31:31.174401 32622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.164314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51152 (local address 127.30.78.65:33165)
0809 06:31:31.164442 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:31.164446 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:31.164754 (+ 308us) server_negotiation.cc:407] Connection header received
0809 06:31:31.164890 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:31.164894 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:31.164956 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:31.165031 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:31.166086 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.166725 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.167804 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.168214 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.168316 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.170242 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:31.170246 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:31.170249 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:31.170276 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:31.172409 (+ 2133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.172951 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.172954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.172956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.173058 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.173300 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.173303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.173305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.173591 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:31.173841 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:31.174021 (+ 180us) server_negotiation.cc:299] Negotiation successful
0809 06:31:31.174180 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 06:31:31.174968 32173 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:31.263334 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31960
I20260809 06:31:31.285331 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32188
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:31:31.299727 32615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.286269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33122 (local address 127.30.78.66:46837)
0809 06:31:31.286436 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:31.286441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:31.286458 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:31:31.286555 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:31.286560 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:31.286623 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:31.286703 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:31.287785 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.288525 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.289708 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.290096 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.290183 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.293954 (+ 3771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:31.293970 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:31.293987 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:31.294024 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:31.297017 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.297615 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.297625 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.297629 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.297796 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.298202 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.298207 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.298210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.298673 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:31.298986 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:31.299141 (+ 155us) server_negotiation.cc:299] Negotiation successful
0809 06:31:31.299363 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:31:31.300441 32381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:31.386103 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 32188
I20260809 06:31:31.408494 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32399
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[31802](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:31:31.422508 32618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:31.409233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32778 (local address 127.30.78.67:38307)
0809 06:31:31.409421 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:31.409427 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:31.409445 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:31:31.409618 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:31.409624 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:31.409693 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:31.409812 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:31.411022 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.411763 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.413004 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:31.413401 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:31.413509 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:31.417496 (+ 3987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:31.417510 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:31.417527 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:31.417561 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:31.420059 (+ 2498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.420715 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.420723 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.420726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.420900 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:31.421214 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:31.421219 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:31.421221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:31.421605 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:31.421851 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:31.422083 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 06:31:31.422264 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:31:31.423096 32585 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:31.510402 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 32399
I20260809 06:31:31.529984 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31820
I20260809 06:31:31.531049 31908 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:31.635625 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31820
2026-08-09T06:31:31Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4091 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[32671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[32671](info): set up 2 sockets
Aug 09 06:31:31 dist-test-slave-cvwc krb5kdc[32671](info): commencing operation
krb5kdc: starting...
W20260809 06:31:32.810292 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.002s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:31:32 dist-test-slave-cvwc krb5kdc[32671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:31:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:31:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:31:32.980213 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36391
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:34945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:36391
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:33.289163 32688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:33.289484 32688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:33.289634 32688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:33.296873 32688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:31:33.296988 32688 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 06:31:33.297066 32688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:33.297164 32688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:33.297237 32688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:31:33.297331 32688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:31:33.307148 32688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:34945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:36391
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36391
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:33.308362 32688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:33.309697 32688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:33.321040 32693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:33.321125 32698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:33.321179 32695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:33.322342 32688 server_base.cc:1034] running on GCE node
I20260809 06:31:33.323074 32688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:33.324344 32688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:33.325574 32688 hybrid_clock.cc:648] HybridClock initialized: now 1786257093325506 us; error 31 us; skew 500 ppm
I20260809 06:31:33.325942 32688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:33 dist-test-slave-cvwc krb5kdc[32671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257093, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:33.329020 32688 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:31:33.330520 32688 webserver.cc:460] Webserver started at http://127.30.78.126:43689/ using document root <none> and password file <none>
I20260809 06:31:33.331172 32688 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:33.331293 32688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:33.331614 32688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:33.334585 32688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "451e4c3ea26444779ebaa435826e6951"
format_stamp: "Formatted at 2026-08-09 06:31:33 on dist-test-slave-cvwc"
server_key: "8f5139b978b2ca1c4dcb543b8ee9f65e"
server_key_iv: "da25722ec1889a67b1a0f6bf39403b02"
server_key_version: "encryptionkey@0"
I20260809 06:31:33.335381 32688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "451e4c3ea26444779ebaa435826e6951"
format_stamp: "Formatted at 2026-08-09 06:31:33 on dist-test-slave-cvwc"
server_key: "8f5139b978b2ca1c4dcb543b8ee9f65e"
server_key_iv: "da25722ec1889a67b1a0f6bf39403b02"
server_key_version: "encryptionkey@0"
I20260809 06:31:33.340477 32688 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 06:31:33.343777 32706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:33.344940 32688 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:31:33.345106 32688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "451e4c3ea26444779ebaa435826e6951"
format_stamp: "Formatted at 2026-08-09 06:31:33 on dist-test-slave-cvwc"
server_key: "8f5139b978b2ca1c4dcb543b8ee9f65e"
server_key_iv: "da25722ec1889a67b1a0f6bf39403b02"
server_key_version: "encryptionkey@0"
I20260809 06:31:33.345315 32688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:33.372639 32688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:33.376940 32688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:33.377218 32688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:33.400259 32688 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:36391
I20260809 06:31:33.400290 323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:36391 every 8 connection(s)
I20260809 06:31:33.401623 32688 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:31:33.403540 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 32688
I20260809 06:31:33.403771 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:31:33.404592 31033 external_mini_cluster.cc:1428] Setting key a57b13935298e03667e17e11a4c3dc74
I20260809 06:31:33.405987 324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:31:33 dist-test-slave-cvwc krb5kdc[32671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:33.419142 324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951: Bootstrap starting.
I20260809 06:31:33.422194 324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:33.423296 324 log.cc:824] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:33.426219 324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951: No bootstrap required, opened a new log
I20260809 06:31:33.426609 328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:33.406522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54864 (local address 127.30.78.126:36391)
0809 06:31:33.407259 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:33.407275 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:33.407327 (+ 52us) server_negotiation.cc:407] Connection header received
0809 06:31:33.409201 (+ 1874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:33.409229 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:33.409769 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:33.410185 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:33.411390 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.413411 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.414618 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.415608 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.415790 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:33.419817 (+ 4027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:33.419825 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:33.419837 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:33.419879 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:33.422719 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:33.423462 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:33.423470 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:33.423476 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:33.423625 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:33.424043 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:33.424051 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:33.424054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:33.424653 (+ 599us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:33.424875 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:33.425284 (+ 409us) server_negotiation.cc:299] Negotiation successful
0809 06:31:33.425591 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":322,"threads_started":1}
I20260809 06:31:33.433192 324 raft_consensus.cc:348] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "451e4c3ea26444779ebaa435826e6951" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36391 } }
I20260809 06:31:33.433490 324 raft_consensus.cc:374] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:33.433588 324 raft_consensus.cc:729] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 451e4c3ea26444779ebaa435826e6951, State: Initialized, Role: FOLLOWER
I20260809 06:31:33.434110 324 consensus_queue.cc:260] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "451e4c3ea26444779ebaa435826e6951" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36391 } }
I20260809 06:31:33.434321 324 raft_consensus.cc:388] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:31:33.434449 324 raft_consensus.cc:482] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:31:33.434597 324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:33.436606 324 raft_consensus.cc:504] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "451e4c3ea26444779ebaa435826e6951" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36391 } }
I20260809 06:31:33.437055 324 leader_election.cc:302] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 451e4c3ea26444779ebaa435826e6951; no voters:
I20260809 06:31:33.437541 324 leader_election.cc:288] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:31:33.437646 331 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:33.438349 331 raft_consensus.cc:686] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [term 1 LEADER]: Becoming Leader. State: Replica: 451e4c3ea26444779ebaa435826e6951, State: Running, Role: LEADER
I20260809 06:31:33.438856 331 consensus_queue.cc:237] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "451e4c3ea26444779ebaa435826e6951" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36391 } }
I20260809 06:31:33.439437 324 sys_catalog.cc:564] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:31:33.441890 332 sys_catalog.cc:455] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "451e4c3ea26444779ebaa435826e6951" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "451e4c3ea26444779ebaa435826e6951" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36391 } } }
I20260809 06:31:33.441862 333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 451e4c3ea26444779ebaa435826e6951. Latest consensus state: current_term: 1 leader_uuid: "451e4c3ea26444779ebaa435826e6951" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "451e4c3ea26444779ebaa435826e6951" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36391 } } }
I20260809 06:31:33.442389 333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:33.442389 332 sys_catalog.cc:458] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:33.450351 342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:31:33.454612 342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:31:33.462035 342 catalog_manager.cc:1347] Generated new cluster ID: c9ae773681c343e3901eb1aec272cc00
I20260809 06:31:33.462206 342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:31:33.479959 342 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:31:33.481220 342 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:31:33.489147 342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951: Generated new TSK 0
I20260809 06:31:33.489979 342 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:31:33.539638 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36391
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:34945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:33.850001 359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:33.850283 359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:33.850430 359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:33.857506 359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:33.857622 359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:33.857776 359 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:31:33.857903 359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:31:33.867369 359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:34945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.78.126:36391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:33.868566 359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:33.869900 359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:33.882258 371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:33.882284 369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:33.882493 368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:33.882946 359 server_base.cc:1034] running on GCE node
I20260809 06:31:33.883512 359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:33.884313 359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:33.885526 359 hybrid_clock.cc:648] HybridClock initialized: now 1786257093885461 us; error 40 us; skew 500 ppm
I20260809 06:31:33.885826 359 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:33 dist-test-slave-cvwc krb5kdc[32671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257093, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:33.892618 359 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:31:33.893982 359 webserver.cc:460] Webserver started at http://127.30.78.65:33015/ using document root <none> and password file <none>
I20260809 06:31:33.894718 359 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:33.894820 359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:33.895176 359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:33.898039 359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "bc9f706b145943f8a7aad6939c9ceb64"
format_stamp: "Formatted at 2026-08-09 06:31:33 on dist-test-slave-cvwc"
server_key: "18584fab2a889ca00cd0c5908d19925a"
server_key_iv: "a1ad643f63526dd773945dbe5e18b259"
server_key_version: "encryptionkey@0"
I20260809 06:31:33.898813 359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "bc9f706b145943f8a7aad6939c9ceb64"
format_stamp: "Formatted at 2026-08-09 06:31:33 on dist-test-slave-cvwc"
server_key: "18584fab2a889ca00cd0c5908d19925a"
server_key_iv: "a1ad643f63526dd773945dbe5e18b259"
server_key_version: "encryptionkey@0"
I20260809 06:31:33.903620 359 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:31:33.906813 384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:33.907997 359 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:31:33.908136 359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "bc9f706b145943f8a7aad6939c9ceb64"
format_stamp: "Formatted at 2026-08-09 06:31:33 on dist-test-slave-cvwc"
server_key: "18584fab2a889ca00cd0c5908d19925a"
server_key_iv: "a1ad643f63526dd773945dbe5e18b259"
server_key_version: "encryptionkey@0"
I20260809 06:31:33.908329 359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:33.937749 359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:33.941810 359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:33.942080 359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:33.945045 359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:33.945170 359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:33.945367 359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:33.945456 359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:31:33 dist-test-slave-cvwc krb5kdc[32671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257093, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:33.968494 402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:33.946431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36391 (local address 127.30.78.65:38649)
0809 06:31:33.947507 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:33.947567 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:33.949508 (+ 1941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:33.950228 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:33.950236 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:33.950768 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:33.951618 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:33.951654 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.952985 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.952989 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:33.954916 (+ 1927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:33.954934 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.956092 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.956100 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:33.956409 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:33.957050 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:33.957084 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:33.960076 (+ 2992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:33.963996 (+ 3920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:33.964005 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:33.964020 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:33.964417 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:33.964857 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:33.964860 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:33.964862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:33.965050 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:33.965707 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:33.965735 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:33.966192 (+ 457us) client_negotiation.cc:769] Sending connection context
0809 06:31:33.966465 (+ 273us) client_negotiation.cc:240] Negotiation successful
0809 06:31:33.966948 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"thread_start_us":434,"threads_started":1}
I20260809 06:31:33.969103 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:33.945401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:38649 (local address 127.30.78.126:36391)
0809 06:31:33.948185 (+ 2784us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:33.948192 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:33.948230 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:31:33.949786 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:33.949792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:33.949889 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:33.949986 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:33.951881 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.952824 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.955086 (+ 2262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.955806 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.955966 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:33.960297 (+ 4331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:33.960302 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:33.960305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:33.960345 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:33.963844 (+ 3499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:33.964540 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:33.964547 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:33.964552 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:33.964741 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:33.965158 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:33.965163 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:33.965167 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:33.965574 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:33.965757 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:33.968517 (+ 2760us) server_negotiation.cc:299] Negotiation successful
0809 06:31:33.968743 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2659,"thread_start_us":2559,"threads_started":1}
I20260809 06:31:33.987051 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:33.974812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:60787 (local address 127.30.78.126:36391)
0809 06:31:33.974948 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:33.974952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:33.975669 (+ 717us) server_negotiation.cc:407] Connection header received
0809 06:31:33.975823 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:33.975827 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:33.975887 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:33.975977 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:33.976843 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.977522 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.979258 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.979712 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.979832 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:33.981863 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:33.981868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:33.981871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:33.981900 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:33.984553 (+ 2653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:33.985203 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:33.985208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:33.985212 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:33.985354 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:33.985701 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:33.985706 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:33.985730 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:33.985999 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:33.986141 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:33.986520 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 06:31:33.986718 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 06:31:33.987147 505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:33.974958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36391 (local address 127.30.78.65:60787)
0809 06:31:33.975569 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:33.975589 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:33.975719 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:33.976018 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:33.976023 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:33.976443 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:33.976710 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:33.976719 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.977654 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.977658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:33.979128 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:33.979141 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:33.979953 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:33.979962 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:33.980168 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:33.980826 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:33.980845 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:33.981683 (+ 838us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:33.984691 (+ 3008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:33.984694 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:33.984697 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:33.985091 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:33.985457 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:33.985461 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:33.985463 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:33.985583 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:33.986115 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:33.986120 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:33.986286 (+ 166us) client_negotiation.cc:769] Sending connection context
0809 06:31:33.986405 (+ 119us) client_negotiation.cc:240] Negotiation successful
0809 06:31:33.986713 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":322,"threads_started":1}
I20260809 06:31:33.997493 359 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:36937
I20260809 06:31:33.997515 566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:36937 every 8 connection(s)
I20260809 06:31:33.998772 359 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:31:34.000662 567 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36391
I20260809 06:31:34.000850 567 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:34.001422 567 heartbeater.cc:511] Master 127.30.78.126:36391 requested a full tablet report, sending...
I20260809 06:31:34.003225 32730 ts_manager.cc:194] Registered new tserver with Master: bc9f706b145943f8a7aad6939c9ceb64 (127.30.78.65:36937)
I20260809 06:31:34.004570 32730 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:38649
I20260809 06:31:34.006438 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 359
I20260809 06:31:34.006665 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:31:34.007387 31033 external_mini_cluster.cc:1428] Setting key 3272658100a2b68a26faefbaa733b870
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:31:34.042802 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36391
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:34945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:34.350171 571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:34.350438 571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:34.350574 571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:34.357465 571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:34.357573 571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:34.357689 571 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:31:34.357816 571 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:31:34.367190 571 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:34945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.78.126:36391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:34.368335 571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:34.369607 571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:34.381824 580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:34.381773 585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:34.381733 577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:34.382838 571 server_base.cc:1034] running on GCE node
I20260809 06:31:34.383399 571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:34.384220 571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:34.385447 571 hybrid_clock.cc:648] HybridClock initialized: now 1786257094385379 us; error 45 us; skew 500 ppm
I20260809 06:31:34.385737 571 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:34 dist-test-slave-cvwc krb5kdc[32671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257094, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:34.388566 571 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:31:34.389886 571 webserver.cc:460] Webserver started at http://127.30.78.66:37339/ using document root <none> and password file <none>
I20260809 06:31:34.390502 571 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:34.390599 571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:34.390902 571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:34.393570 571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "c1ae2ba0980a42509204c24fb365afc8"
format_stamp: "Formatted at 2026-08-09 06:31:34 on dist-test-slave-cvwc"
server_key: "d1bb55b995f4ceced78f5870f22a64cd"
server_key_iv: "ddebc025c311578191e57e6747934bdc"
server_key_version: "encryptionkey@0"
I20260809 06:31:34.394361 571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "c1ae2ba0980a42509204c24fb365afc8"
format_stamp: "Formatted at 2026-08-09 06:31:34 on dist-test-slave-cvwc"
server_key: "d1bb55b995f4ceced78f5870f22a64cd"
server_key_iv: "ddebc025c311578191e57e6747934bdc"
server_key_version: "encryptionkey@0"
I20260809 06:31:34.398962 571 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 06:31:34.402208 594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:34.403414 571 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:31:34.403539 571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "c1ae2ba0980a42509204c24fb365afc8"
format_stamp: "Formatted at 2026-08-09 06:31:34 on dist-test-slave-cvwc"
server_key: "d1bb55b995f4ceced78f5870f22a64cd"
server_key_iv: "ddebc025c311578191e57e6747934bdc"
server_key_version: "encryptionkey@0"
I20260809 06:31:34.403725 571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:34.446004 571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:34.449966 571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:34.450218 571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:34.452802 571 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:34.452908 571 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:34.453078 571 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:34.453150 571 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:31:34 dist-test-slave-cvwc krb5kdc[32671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257094, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:34.475363 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:34.453432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:44011 (local address 127.30.78.126:36391)
0809 06:31:34.453596 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:34.453601 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:34.455071 (+ 1470us) server_negotiation.cc:407] Connection header received
0809 06:31:34.457189 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:34.457196 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:34.457286 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:34.457396 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:34.459784 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.460953 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.463175 (+ 2222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.463891 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.464032 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:34.468467 (+ 4435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:34.468474 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:34.468478 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:34.468519 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:34.471615 (+ 3096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:34.472573 (+ 958us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:34.472579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:34.472583 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:34.472711 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:34.473165 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:34.473170 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:34.473174 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:34.473513 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:34.473679 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:34.474759 (+ 1080us) server_negotiation.cc:299] Negotiation successful
0809 06:31:34.475007 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 06:31:34.477053 607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:34.454138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36391 (local address 127.30.78.66:44011)
0809 06:31:34.454919 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:34.454965 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:34.456894 (+ 1929us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:34.457687 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:34.457697 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:34.458561 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:34.459522 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:34.459556 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.461136 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.461141 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:34.463006 (+ 1865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:34.463024 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.464099 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.464104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:34.464273 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:34.464940 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:34.464975 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:34.468179 (+ 3204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:34.471786 (+ 3607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:34.471795 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:34.471812 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:34.472448 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:34.472817 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:34.472825 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:34.472829 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:34.473048 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:34.473683 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:34.473693 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:34.474270 (+ 577us) client_negotiation.cc:769] Sending connection context
0809 06:31:34.474635 (+ 365us) client_negotiation.cc:240] Negotiation successful
0809 06:31:34.475267 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":353,"threads_started":1}
I20260809 06:31:34.492785 571 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:39195
I20260809 06:31:34.492810 775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:39195 every 8 connection(s)
I20260809 06:31:34.494062 571 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:31:34.496248 777 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36391
I20260809 06:31:34.496498 777 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:34.496889 744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:34.483007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36391 (local address 127.30.78.66:58295)
0809 06:31:34.483621 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:34.483635 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:34.483760 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:34.484053 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:34.484058 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:34.484478 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:34.484748 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:34.484757 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.485744 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.485750 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:34.487347 (+ 1597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:34.487365 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.488620 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.488629 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:34.488819 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:34.489804 (+ 985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:34.489833 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:34.491054 (+ 1221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:34.494106 (+ 3052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:34.494112 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:34.494116 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:34.494621 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:34.495076 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:34.495081 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:34.495084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:34.495249 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:34.495896 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:34.495901 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:34.496091 (+ 190us) client_negotiation.cc:769] Sending connection context
0809 06:31:34.496244 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 06:31:34.496524 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":370,"threads_started":1}
I20260809 06:31:34.496901 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:34.482914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:58295 (local address 127.30.78.126:36391)
0809 06:31:34.483074 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:34.483080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:34.483715 (+ 635us) server_negotiation.cc:407] Connection header received
0809 06:31:34.483864 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:34.483877 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:34.483939 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:34.484017 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:34.484885 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.485603 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.487510 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.488180 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.488305 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:34.491214 (+ 2909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:34.491219 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:34.491222 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:34.491252 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:34.493987 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:34.494755 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:34.494761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:34.494765 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:34.494932 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:34.495409 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:34.495414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:34.495417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:34.495771 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:34.495910 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:34.496353 (+ 443us) server_negotiation.cc:299] Negotiation successful
0809 06:31:34.496594 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 06:31:34.497229 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 571
I20260809 06:31:34.497362 777 heartbeater.cc:511] Master 127.30.78.126:36391 requested a full tablet report, sending...
I20260809 06:31:34.497429 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:31:34.497941 31033 external_mini_cluster.cc:1428] Setting key fb917f93bfdee4e4fda5725ad8004ee7
I20260809 06:31:34.498852 32728 ts_manager.cc:194] Registered new tserver with Master: c1ae2ba0980a42509204c24fb365afc8 (127.30.78.66:39195)
I20260809 06:31:34.500065 32728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:44011
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:31:34.534902 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36391
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:34945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:34.851608 784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:34.851982 784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:34.852140 784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:34.859742 784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:34.859858 784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:34.859982 784 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:31:34.860095 784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:31:34.869812 784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:34945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.78.126:36391
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:34.871049 784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:34.872335 784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:34.884948 791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:34.884984 793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:34.885795 789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:34.886818 784 server_base.cc:1034] running on GCE node
I20260809 06:31:34.887570 784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:34.888700 784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:34.889899 784 hybrid_clock.cc:648] HybridClock initialized: now 1786257094889809 us; error 58 us; skew 500 ppm
I20260809 06:31:34.890256 784 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:34 dist-test-slave-cvwc krb5kdc[32671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257094, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:34.894114 784 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:31:34.895470 784 webserver.cc:460] Webserver started at http://127.30.78.67:39883/ using document root <none> and password file <none>
I20260809 06:31:34.896137 784 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:34.896237 784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:34.896536 784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:34.899490 784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "524b2e2cc3154c4e83f0043071b36a16"
format_stamp: "Formatted at 2026-08-09 06:31:34 on dist-test-slave-cvwc"
server_key: "1892ae125dd1bfbdc9d7f66666f05887"
server_key_iv: "2567bc46b3f2df54c0e5164cb92c79a1"
server_key_version: "encryptionkey@0"
I20260809 06:31:34.900286 784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "524b2e2cc3154c4e83f0043071b36a16"
format_stamp: "Formatted at 2026-08-09 06:31:34 on dist-test-slave-cvwc"
server_key: "1892ae125dd1bfbdc9d7f66666f05887"
server_key_iv: "2567bc46b3f2df54c0e5164cb92c79a1"
server_key_version: "encryptionkey@0"
I20260809 06:31:34.905210 784 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 06:31:34.908601 801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:34.909904 784 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:31:34.910054 784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "524b2e2cc3154c4e83f0043071b36a16"
format_stamp: "Formatted at 2026-08-09 06:31:34 on dist-test-slave-cvwc"
server_key: "1892ae125dd1bfbdc9d7f66666f05887"
server_key_iv: "2567bc46b3f2df54c0e5164cb92c79a1"
server_key_version: "encryptionkey@0"
I20260809 06:31:34.910259 784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:34.935796 784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:34.939819 784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:34.940071 784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:34.942844 784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:34.942934 784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:34.943097 784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:34.943166 784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:31:34 dist-test-slave-cvwc krb5kdc[32671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257094, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:34.964830 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:34.943222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:56679 (local address 127.30.78.126:36391)
0809 06:31:34.943462 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:34.943469 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:34.944882 (+ 1413us) server_negotiation.cc:407] Connection header received
0809 06:31:34.946976 (+ 2094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:34.946984 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:34.947076 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:34.947181 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:34.949282 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.950588 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.952976 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.953406 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.953514 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:34.957952 (+ 4438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:34.957960 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:34.957965 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:34.958012 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:34.961359 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:34.962110 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:34.962116 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:34.962119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:34.962294 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:34.962903 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:34.962908 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:34.962911 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:34.963212 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:34.963348 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:34.964242 (+ 894us) server_negotiation.cc:299] Negotiation successful
0809 06:31:34.964473 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:31:34.966290 815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:34.943888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36391 (local address 127.30.78.67:56679)
0809 06:31:34.944709 (+ 821us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:34.944758 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:34.946705 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:34.947465 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:34.947478 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:34.948188 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:34.949067 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:34.949089 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.950762 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.950768 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:34.952829 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:34.952842 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.953647 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.953656 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:34.953941 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:34.954703 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:34.954738 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:34.957678 (+ 2940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:34.961493 (+ 3815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:34.961500 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:34.961511 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:34.961994 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:34.962425 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:34.962431 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:34.962436 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:34.962741 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:34.963340 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:34.963347 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:34.963767 (+ 420us) client_negotiation.cc:769] Sending connection context
0809 06:31:34.964090 (+ 323us) client_negotiation.cc:240] Negotiation successful
0809 06:31:34.964652 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":351,"threads_started":1}
I20260809 06:31:34.986593 784 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:44903
I20260809 06:31:34.986649 984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:44903 every 8 connection(s)
I20260809 06:31:34.987913 932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:34.972900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36391 (local address 127.30.78.67:58041)
0809 06:31:34.973839 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:34.973858 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:34.973995 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:34.974427 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:34.974435 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:34.975101 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:34.975551 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:34.975565 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.976916 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.976921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:34.978625 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:34.978642 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.979634 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.979640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:34.979796 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:34.980485 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:34.980502 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:34.981559 (+ 1057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:34.985349 (+ 3790us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:34.985353 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:34.985357 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:34.985942 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:34.986357 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:34.986362 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:34.986366 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:34.986532 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:34.987118 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:34.987122 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:34.987271 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 06:31:34.987374 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 06:31:34.987596 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":757,"thread_start_us":620,"threads_started":1}
I20260809 06:31:34.988076 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:34.972780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:58041 (local address 127.30.78.126:36391)
0809 06:31:34.972930 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:34.972936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:34.973935 (+ 999us) server_negotiation.cc:407] Connection header received
0809 06:31:34.974101 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:34.974107 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:34.974177 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:34.974261 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:34.975727 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.976707 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.978783 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:34.979275 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:34.979398 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:34.981793 (+ 2395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:34.981798 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:34.981801 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:34.981830 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:34.985219 (+ 3389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:34.986047 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:34.986053 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:34.986058 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:34.986221 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:34.986665 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:34.986670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:34.986673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:34.987007 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:34.987153 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:34.987527 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 06:31:34.987750 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260809 06:31:34.988186 784 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:31:34.989552 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 784
I20260809 06:31:34.989778 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:31:34.990329 31033 external_mini_cluster.cc:1428] Setting key 32b8843877fb9597e3fddc4c4cda72ad
I20260809 06:31:34.990185 987 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36391
I20260809 06:31:34.991446 987 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:34.992210 987 heartbeater.cc:511] Master 127.30.78.126:36391 requested a full tablet report, sending...
I20260809 06:31:34.993453 32728 ts_manager.cc:194] Registered new tserver with Master: 524b2e2cc3154c4e83f0043071b36a16 (127.30.78.67:44903)
I20260809 06:31:34.994268 32728 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:56679
I20260809 06:31:35.005066 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:31:35.007321 567 heartbeater.cc:503] Master 127.30.78.126:36391 was elected leader, sending a full tablet report...
Aug 09 06:31:35 dist-test-slave-cvwc krb5kdc[32671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257095, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 06:31:35 dist-test-slave-cvwc krb5kdc[32671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257095, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:35.048023 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.035094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54876 (local address 127.30.78.126:36391)
0809 06:31:35.035250 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.035254 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.035566 (+ 312us) server_negotiation.cc:407] Connection header received
0809 06:31:35.035711 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.035715 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.035775 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.035858 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:35.037129 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.037925 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.039111 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.039549 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.039638 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.043256 (+ 3618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:35.043261 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:35.043264 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:35.043297 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:35.045936 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:35.046478 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:35.046482 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:35.046484 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:35.046594 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:35.046889 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:35.046891 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:35.046893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:35.047149 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:35.047328 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.047529 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.047690 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:31:35.051812 32728 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:31:35.059495 32728 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:31:35.105810 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.072159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38906 (local address 127.30.78.67:44903)
0809 06:31:35.096420 (+ 24261us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.096430 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.096471 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:31:35.096580 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.096589 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.096889 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.097097 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:35.098976 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.100655 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.103823 (+ 3168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.104704 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.104824 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.105065 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.105314 (+ 249us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.105462 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24059,"thread_start_us":25221,"threads_started":1}
I20260809 06:31:35.105947 1009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.071541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:44903 (local address 127.0.0.1:38906)
0809 06:31:35.095705 (+ 24164us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.095723 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.095828 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.097909 (+ 2081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.097918 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.097954 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:35.098808 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.098815 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.100757 (+ 1942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.100761 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.103632 (+ 2871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.103652 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.104896 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.104902 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.105073 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.105122 (+ 49us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.105231 (+ 109us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.105427 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24044,"mutex_wait_us":190,"thread_start_us":22194,"threads_started":1}
I20260809 06:31:35.106065 1013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.071655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:39195 (local address 127.0.0.1:58970)
0809 06:31:35.097799 (+ 26144us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.097817 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.097927 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.099333 (+ 1406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.099338 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.099364 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:35.099793 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.099805 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.101363 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.101376 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.103213 (+ 1837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.103230 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.105202 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.105209 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.105388 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.105425 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.105503 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.105625 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26007,"mutex_wait_us":31,"thread_start_us":26345,"threads_started":1}
I20260809 06:31:35.106528 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.070977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:36937 (local address 127.0.0.1:47380)
0809 06:31:35.094811 (+ 23834us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.094860 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.095088 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.098062 (+ 2974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.098066 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.098098 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:35.098631 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.098644 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.100740 (+ 2096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.100745 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.103658 (+ 2913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.103667 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.105424 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.105430 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.105574 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.105603 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.105655 (+ 52us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.105802 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23548,"mutex_wait_us":274,"thread_start_us":24919,"threads_started":1}
I20260809 06:31:35.106794 1015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.071913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58970 (local address 127.30.78.66:39195)
0809 06:31:35.098595 (+ 26682us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.098604 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.098628 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:31:35.098704 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.098709 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.098932 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.099122 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:35.100002 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.101233 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.103416 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.104728 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.104860 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.105051 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.106291 (+ 1240us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.106466 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26503,"thread_start_us":26365,"threads_started":1}
I20260809 06:31:35.107719 1010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.071222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47380 (local address 127.30.78.65:36937)
0809 06:31:35.097457 (+ 26235us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.097465 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.097496 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:31:35.097591 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.097598 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.097859 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.098407 (+ 548us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:35.098795 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.100595 (+ 1800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.103829 (+ 3234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.105198 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.107041 (+ 1843us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.107232 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.107292 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.107442 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26086,"thread_start_us":25950,"threads_started":1}
I20260809 06:31:35.109905 887 tablet_service.cc:1467] Processing CreateTablet for tablet bb1a53dc46fc4a1f84f714deabc63267 (DEFAULT_TABLE table=test-table [id=c07c65d0a15b4fa7b44843c342a81e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:35.110006 669 tablet_service.cc:1467] Processing CreateTablet for tablet bb1a53dc46fc4a1f84f714deabc63267 (DEFAULT_TABLE table=test-table [id=c07c65d0a15b4fa7b44843c342a81e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:35.111196 887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1a53dc46fc4a1f84f714deabc63267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:35.111321 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1a53dc46fc4a1f84f714deabc63267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:35.111207 461 tablet_service.cc:1467] Processing CreateTablet for tablet bb1a53dc46fc4a1f84f714deabc63267 (DEFAULT_TABLE table=test-table [id=c07c65d0a15b4fa7b44843c342a81e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:35.112471 461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb1a53dc46fc4a1f84f714deabc63267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:35.122574 1018 tablet_bootstrap.cc:492] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: Bootstrap starting.
I20260809 06:31:35.125975 1018 tablet_bootstrap.cc:654] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:35.126958 1018 log.cc:824] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:35.130466 1021 tablet_bootstrap.cc:492] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: Bootstrap starting.
I20260809 06:31:35.131337 1020 tablet_bootstrap.cc:492] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: Bootstrap starting.
I20260809 06:31:35.135219 1021 tablet_bootstrap.cc:654] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:35.135334 1020 tablet_bootstrap.cc:654] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:35.136207 1021 log.cc:824] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:35.136453 1018 tablet_bootstrap.cc:492] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: No bootstrap required, opened a new log
I20260809 06:31:35.136631 1020 log.cc:824] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:35.136749 1018 ts_tablet_manager.cc:1397] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260809 06:31:35.138628 1021 tablet_bootstrap.cc:492] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: No bootstrap required, opened a new log
I20260809 06:31:35.138849 1021 ts_tablet_manager.cc:1397] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 06:31:35.144143 1020 tablet_bootstrap.cc:492] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: No bootstrap required, opened a new log
I20260809 06:31:35.144439 1020 ts_tablet_manager.cc:1397] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.007s
I20260809 06:31:35.144284 1018 raft_consensus.cc:348] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } }
I20260809 06:31:35.144765 1018 raft_consensus.cc:374] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:35.144891 1018 raft_consensus.cc:729] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 524b2e2cc3154c4e83f0043071b36a16, State: Initialized, Role: FOLLOWER
I20260809 06:31:35.145498 1018 consensus_queue.cc:260] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } }
I20260809 06:31:35.146559 987 heartbeater.cc:503] Master 127.30.78.126:36391 was elected leader, sending a full tablet report...
I20260809 06:31:35.147200 1018 ts_tablet_manager.cc:1428] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: Time spent starting tablet: real 0.010s user 0.012s sys 0.000s
I20260809 06:31:35.147339 1021 raft_consensus.cc:348] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } }
I20260809 06:31:35.147725 1021 raft_consensus.cc:374] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:35.147812 1021 raft_consensus.cc:729] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ae2ba0980a42509204c24fb365afc8, State: Initialized, Role: FOLLOWER
I20260809 06:31:35.148501 1021 consensus_queue.cc:260] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } }
I20260809 06:31:35.153491 1026 raft_consensus.cc:482] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:35.153817 1026 raft_consensus.cc:504] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } }
I20260809 06:31:35.155061 1020 raft_consensus.cc:348] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } }
I20260809 06:31:35.155506 1020 raft_consensus.cc:374] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:35.155604 1020 raft_consensus.cc:729] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9f706b145943f8a7aad6939c9ceb64, State: Initialized, Role: FOLLOWER
I20260809 06:31:35.156307 1020 consensus_queue.cc:260] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } }
I20260809 06:31:35.164489 1020 ts_tablet_manager.cc:1428] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: Time spent starting tablet: real 0.020s user 0.017s sys 0.002s
I20260809 06:31:35.164871 1026 leader_election.cc:288] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc9f706b145943f8a7aad6939c9ceb64 (127.30.78.65:36937), c1ae2ba0980a42509204c24fb365afc8 (127.30.78.66:39195)
I20260809 06:31:35.166010 777 heartbeater.cc:503] Master 127.30.78.126:36391 was elected leader, sending a full tablet report...
I20260809 06:31:35.166838 1021 ts_tablet_manager.cc:1428] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: Time spent starting tablet: real 0.028s user 0.019s sys 0.008s
I20260809 06:31:35.167348 815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.155835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:36937 (local address 127.30.78.67:46145)
0809 06:31:35.156201 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.156222 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.156348 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.157783 (+ 1435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.157789 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.157821 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:35.158035 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.158045 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.159627 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.159633 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.161775 (+ 2142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.161793 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.164294 (+ 2501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.164299 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.164490 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.164523 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.164613 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.164748 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216}
I20260809 06:31:35.167640 1010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.156561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:46145 (local address 127.30.78.65:36937)
0809 06:31:35.156763 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.156769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.156791 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:31:35.156859 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.156864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.156954 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.157041 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:35.158213 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.159431 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.162661 (+ 3230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.163953 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.164116 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.164188 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.164949 (+ 761us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.165072 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:31:35.168960 493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a53dc46fc4a1f84f714deabc63267" candidate_uuid: "524b2e2cc3154c4e83f0043071b36a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9f706b145943f8a7aad6939c9ceb64" is_pre_election: true
I20260809 06:31:35.169495 493 raft_consensus.cc:2454] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 524b2e2cc3154c4e83f0043071b36a16 in term 0.
I20260809 06:31:35.170185 804 leader_election.cc:302] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 524b2e2cc3154c4e83f0043071b36a16, bc9f706b145943f8a7aad6939c9ceb64; no voters:
I20260809 06:31:35.170619 1029 raft_consensus.cc:2781] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:35.170773 1029 raft_consensus.cc:482] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:35.170931 1029 raft_consensus.cc:3037] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:35.173561 1029 raft_consensus.cc:504] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } }
I20260809 06:31:35.174249 1029 leader_election.cc:288] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [CANDIDATE]: Term 1 election: Requested vote from peers bc9f706b145943f8a7aad6939c9ceb64 (127.30.78.65:36937), c1ae2ba0980a42509204c24fb365afc8 (127.30.78.66:39195)
I20260809 06:31:35.174319 1015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.166014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:35555 (local address 127.30.78.66:39195)
0809 06:31:35.166199 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.166204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.168823 (+ 2619us) server_negotiation.cc:407] Connection header received
0809 06:31:35.168908 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.168913 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.168986 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.169071 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:35.169599 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.170593 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.172566 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.173361 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.173514 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.173583 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.173951 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.174072 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 06:31:35.174350 815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.166322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:39195 (local address 127.30.78.67:35555)
0809 06:31:35.168228 (+ 1906us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.168247 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.168362 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.169253 (+ 891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.169258 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.169285 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:35.169444 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.169453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.170733 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.170739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.172414 (+ 1675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.172426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.173555 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.173561 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.173763 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.173799 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.173893 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.174039 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1783,"thread_start_us":2316,"threads_started":1}
I20260809 06:31:35.174657 493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a53dc46fc4a1f84f714deabc63267" candidate_uuid: "524b2e2cc3154c4e83f0043071b36a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9f706b145943f8a7aad6939c9ceb64"
I20260809 06:31:35.174829 493 raft_consensus.cc:3037] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:35.175333 697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a53dc46fc4a1f84f714deabc63267" candidate_uuid: "524b2e2cc3154c4e83f0043071b36a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ae2ba0980a42509204c24fb365afc8"
I20260809 06:31:35.175292 699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bb1a53dc46fc4a1f84f714deabc63267" candidate_uuid: "524b2e2cc3154c4e83f0043071b36a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ae2ba0980a42509204c24fb365afc8" is_pre_election: true
I20260809 06:31:35.175761 697 raft_consensus.cc:3037] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:35.177559 493 raft_consensus.cc:2454] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 524b2e2cc3154c4e83f0043071b36a16 in term 1.
I20260809 06:31:35.178035 804 leader_election.cc:302] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 524b2e2cc3154c4e83f0043071b36a16, bc9f706b145943f8a7aad6939c9ceb64; no voters:
I20260809 06:31:35.178319 1029 raft_consensus.cc:2781] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:35.178505 1029 raft_consensus.cc:686] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 LEADER]: Becoming Leader. State: Replica: 524b2e2cc3154c4e83f0043071b36a16, State: Running, Role: LEADER
I20260809 06:31:35.178612 697 raft_consensus.cc:2454] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 524b2e2cc3154c4e83f0043071b36a16 in term 1.
I20260809 06:31:35.178961 1029 consensus_queue.cc:237] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } }
I20260809 06:31:35.183501 32728 catalog_manager.cc:5495] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 524b2e2cc3154c4e83f0043071b36a16 (127.30.78.67). New cstate: current_term: 1 leader_uuid: "524b2e2cc3154c4e83f0043071b36a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } health_report { overall_health: UNKNOWN } } }
I20260809 06:31:35.214257 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.209247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38916 (local address 127.30.78.67:44903)
0809 06:31:35.209450 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.209455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.209472 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:31:35.209680 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.209683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.209807 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.209953 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:35.210242 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.210980 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.212253 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.212658 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.212748 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.213188 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:35.213671 (+ 483us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:35.213834 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.213939 (+ 105us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.214003 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:31:35.221573 697 raft_consensus.cc:1261] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Refusing update from remote peer 524b2e2cc3154c4e83f0043071b36a16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:35.221652 493 raft_consensus.cc:1261] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 FOLLOWER]: Refusing update from remote peer 524b2e2cc3154c4e83f0043071b36a16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:35.222378 1026 consensus_queue.cc:1035] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:35.222681 1029 consensus_queue.cc:1035] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:35.242656 1045 mvcc.cc:205] Tried to move back new op lower bound from 7316509062019497984 to 7316509061856796672. Current Snapshot: MvccSnapshot[applied={T|T < 7316509062019497984}]
I20260809 06:31:35.252437 32727 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:35.252701 32727 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:35.256743 32727 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951: Sending DeleteTablet for 3 replicas of tablet bb1a53dc46fc4a1f84f714deabc63267
I20260809 06:31:35.257899 887 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a53dc46fc4a1f84f714deabc63267 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:35 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:38906
I20260809 06:31:35.257907 461 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a53dc46fc4a1f84f714deabc63267 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:35 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:47380
I20260809 06:31:35.259074 669 tablet_service.cc:1514] Processing DeleteTablet for tablet bb1a53dc46fc4a1f84f714deabc63267 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:35 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:58970
I20260809 06:31:35.259289 32728 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:31:35.259938 32728 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:31:35.267877 885 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5f139db0f841dfa933305469295473 (DEFAULT_TABLE table=test-table [id=91a36b5abb4a4c8d896a7f83ab77ecf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:35.268553 885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5f139db0f841dfa933305469295473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:35.268774 1056 tablet_replica.cc:330] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: stopping tablet replica
I20260809 06:31:35.269466 1056 raft_consensus.cc:2229] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:35.270471 669 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5f139db0f841dfa933305469295473 (DEFAULT_TABLE table=test-table [id=91a36b5abb4a4c8d896a7f83ab77ecf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:35.270779 460 tablet_service.cc:1467] Processing CreateTablet for tablet 9f5f139db0f841dfa933305469295473 (DEFAULT_TABLE table=test-table [id=91a36b5abb4a4c8d896a7f83ab77ecf1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:35.270924 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5f139db0f841dfa933305469295473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:35.271256 1056 raft_consensus.cc:2258] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:35.271332 460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f5f139db0f841dfa933305469295473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:35.273977 1056 ts_tablet_manager.cc:1905] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:35.276312 1018 tablet_bootstrap.cc:492] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: Bootstrap starting.
I20260809 06:31:35.278153 1018 tablet_bootstrap.cc:654] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:35.279435 1020 tablet_bootstrap.cc:492] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: Bootstrap starting.
I20260809 06:31:35.281119 1020 tablet_bootstrap.cc:654] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:35.284564 1020 tablet_bootstrap.cc:492] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: No bootstrap required, opened a new log
I20260809 06:31:35.284765 1020 ts_tablet_manager.cc:1397] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 06:31:35.284845 1056 ts_tablet_manager.cc:1918] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:31:35.285043 1056 log.cc:1196] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/bb1a53dc46fc4a1f84f714deabc63267
I20260809 06:31:35.285569 1056 ts_tablet_manager.cc:1939] T bb1a53dc46fc4a1f84f714deabc63267 P c1ae2ba0980a42509204c24fb365afc8: Deleting consensus metadata
I20260809 06:31:35.286906 1020 raft_consensus.cc:348] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.287226 1020 raft_consensus.cc:374] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:35.287389 1020 raft_consensus.cc:729] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9f706b145943f8a7aad6939c9ceb64, State: Initialized, Role: FOLLOWER
I20260809 06:31:35.287515 32712 catalog_manager.cc:4841] TS c1ae2ba0980a42509204c24fb365afc8 (127.30.78.66:39195): tablet bb1a53dc46fc4a1f84f714deabc63267 (table test-table [id=c07c65d0a15b4fa7b44843c342a81e47]) successfully deleted
I20260809 06:31:35.287820 1020 consensus_queue.cc:260] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.288486 1020 ts_tablet_manager.cc:1428] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 06:31:35.295977 1021 tablet_bootstrap.cc:492] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: Bootstrap starting.
I20260809 06:31:35.297612 1021 tablet_bootstrap.cc:654] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:35.298161 1018 tablet_bootstrap.cc:492] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: No bootstrap required, opened a new log
I20260809 06:31:35.298328 1018 ts_tablet_manager.cc:1397] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.000s
I20260809 06:31:35.299268 1018 raft_consensus.cc:348] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.299546 1018 raft_consensus.cc:374] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:35.299649 1018 raft_consensus.cc:729] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 524b2e2cc3154c4e83f0043071b36a16, State: Initialized, Role: FOLLOWER
I20260809 06:31:35.299983 1018 consensus_queue.cc:260] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.303001 1018 ts_tablet_manager.cc:1428] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260809 06:31:35.306226 1053 tablet_replica.cc:330] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: stopping tablet replica
I20260809 06:31:35.306744 1053 raft_consensus.cc:2229] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:31:35.307499 1054 tablet_replica.cc:330] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: stopping tablet replica
I20260809 06:31:35.307883 1054 raft_consensus.cc:2229] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:35.308350 1054 raft_consensus.cc:2258] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:35.309820 1053 raft_consensus.cc:2258] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:35.310071 1021 tablet_bootstrap.cc:492] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: No bootstrap required, opened a new log
I20260809 06:31:35.310454 1021 ts_tablet_manager.cc:1397] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.003s
I20260809 06:31:35.310575 1054 ts_tablet_manager.cc:1905] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:35.311785 1053 ts_tablet_manager.cc:1905] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:35.311319 1021 raft_consensus.cc:348] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.312799 1021 raft_consensus.cc:374] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:35.312963 1021 raft_consensus.cc:729] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ae2ba0980a42509204c24fb365afc8, State: Initialized, Role: FOLLOWER
I20260809 06:31:35.313220 1021 consensus_queue.cc:260] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.313885 1021 ts_tablet_manager.cc:1428] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 06:31:35.319195 1054 ts_tablet_manager.cc:1918] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:31:35.319213 1053 ts_tablet_manager.cc:1918] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:31:35.319370 1053 log.cc:1196] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/bb1a53dc46fc4a1f84f714deabc63267
I20260809 06:31:35.319419 1054 log.cc:1196] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/bb1a53dc46fc4a1f84f714deabc63267
I20260809 06:31:35.319933 1054 ts_tablet_manager.cc:1939] T bb1a53dc46fc4a1f84f714deabc63267 P bc9f706b145943f8a7aad6939c9ceb64: Deleting consensus metadata
I20260809 06:31:35.319933 1053 ts_tablet_manager.cc:1939] T bb1a53dc46fc4a1f84f714deabc63267 P 524b2e2cc3154c4e83f0043071b36a16: Deleting consensus metadata
I20260809 06:31:35.321655 32708 catalog_manager.cc:4841] TS 524b2e2cc3154c4e83f0043071b36a16 (127.30.78.67:44903): tablet bb1a53dc46fc4a1f84f714deabc63267 (table test-table [id=c07c65d0a15b4fa7b44843c342a81e47]) successfully deleted
I20260809 06:31:35.321740 32709 catalog_manager.cc:4841] TS bc9f706b145943f8a7aad6939c9ceb64 (127.30.78.65:36937): tablet bb1a53dc46fc4a1f84f714deabc63267 (table test-table [id=c07c65d0a15b4fa7b44843c342a81e47]) successfully deleted
I20260809 06:31:35.407379 1034 raft_consensus.cc:482] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:35.407578 1034 raft_consensus.cc:504] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.409261 1034 leader_election.cc:288] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c1ae2ba0980a42509204c24fb365afc8 (127.30.78.66:39195), 524b2e2cc3154c4e83f0043071b36a16 (127.30.78.67:44903)
I20260809 06:31:35.428260 1033 raft_consensus.cc:482] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:35.428519 1033 raft_consensus.cc:504] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.428900 1015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.410115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:39493 (local address 127.30.78.66:39195)
0809 06:31:35.410280 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.410285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.420869 (+ 10584us) server_negotiation.cc:407] Connection header received
0809 06:31:35.421368 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.421387 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.421473 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.421539 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:35.422537 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.423738 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.426305 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.427519 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.427649 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.427719 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.428451 (+ 732us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.428584 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:31:35.429611 1060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.409593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:39195 (local address 127.30.78.65:39493)
0809 06:31:35.420752 (+ 11159us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.420774 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.421184 (+ 410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.421799 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.421803 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.421843 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:35.422316 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.422329 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.423940 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.423945 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.426146 (+ 2201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.426159 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.428074 (+ 1915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.428080 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.428244 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.428278 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.429080 (+ 802us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.429227 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11010,"thread_start_us":11286,"threads_started":1}
I20260809 06:31:35.430441 1033 leader_election.cc:288] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc9f706b145943f8a7aad6939c9ceb64 (127.30.78.65:36937), 524b2e2cc3154c4e83f0043071b36a16 (127.30.78.67:44903)
I20260809 06:31:35.430524 697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5f139db0f841dfa933305469295473" candidate_uuid: "bc9f706b145943f8a7aad6939c9ceb64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ae2ba0980a42509204c24fb365afc8" is_pre_election: true
I20260809 06:31:35.430752 697 raft_consensus.cc:2454] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9f706b145943f8a7aad6939c9ceb64 in term 0.
I20260809 06:31:35.431339 390 leader_election.cc:302] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9f706b145943f8a7aad6939c9ceb64, c1ae2ba0980a42509204c24fb365afc8; no voters:
I20260809 06:31:35.432242 1034 raft_consensus.cc:2781] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:35.432370 1034 raft_consensus.cc:482] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:35.432466 1034 raft_consensus.cc:3037] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:35.433931 1061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.409682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:44903 (local address 127.30.78.65:59393)
0809 06:31:35.425515 (+ 15833us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.425533 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.425893 (+ 360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.426414 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.426419 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.426444 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:35.426778 (+ 334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.426789 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.429209 (+ 2420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.429213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.431145 (+ 1932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.431161 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.433021 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.433028 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.433266 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.433303 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.433410 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.433551 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15719,"thread_start_us":15433,"threads_started":1}
I20260809 06:31:35.434937 1016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.409970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:59393 (local address 127.30.78.67:44903)
0809 06:31:35.410145 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.410151 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.425616 (+ 15465us) server_negotiation.cc:407] Connection header received
0809 06:31:35.426066 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.426072 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.426149 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.426213 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:35.427020 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.428058 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.431344 (+ 3286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.432576 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.432764 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.432833 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.434497 (+ 1664us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.434638 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:31:35.435703 1034 raft_consensus.cc:504] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.437204 697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5f139db0f841dfa933305469295473" candidate_uuid: "bc9f706b145943f8a7aad6939c9ceb64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ae2ba0980a42509204c24fb365afc8"
I20260809 06:31:35.437417 697 raft_consensus.cc:3037] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:35.438019 1034 leader_election.cc:288] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [CANDIDATE]: Term 1 election: Requested vote from peers c1ae2ba0980a42509204c24fb365afc8 (127.30.78.66:39195), 524b2e2cc3154c4e83f0043071b36a16 (127.30.78.67:44903)
I20260809 06:31:35.438977 913 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5f139db0f841dfa933305469295473" candidate_uuid: "bc9f706b145943f8a7aad6939c9ceb64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "524b2e2cc3154c4e83f0043071b36a16" is_pre_election: true
I20260809 06:31:35.439030 912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5f139db0f841dfa933305469295473" candidate_uuid: "bc9f706b145943f8a7aad6939c9ceb64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "524b2e2cc3154c4e83f0043071b36a16"
I20260809 06:31:35.439425 912 raft_consensus.cc:3037] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:35.440536 697 raft_consensus.cc:2454] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9f706b145943f8a7aad6939c9ceb64 in term 1.
I20260809 06:31:35.440974 390 leader_election.cc:302] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9f706b145943f8a7aad6939c9ceb64, c1ae2ba0980a42509204c24fb365afc8; no voters:
I20260809 06:31:35.442790 912 raft_consensus.cc:2454] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9f706b145943f8a7aad6939c9ceb64 in term 1.
I20260809 06:31:35.443279 1034 raft_consensus.cc:2781] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:35.444401 1064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.432017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:59309 (local address 127.30.78.67:44903)
0809 06:31:35.434648 (+ 2631us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.434653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.435812 (+ 1159us) server_negotiation.cc:407] Connection header received
0809 06:31:35.436099 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.436104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.436173 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.436244 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:35.437259 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.438601 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.441538 (+ 2937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.442990 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.443157 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.443230 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.443884 (+ 654us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.444025 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2491,"thread_start_us":2339,"threads_started":1}
I20260809 06:31:35.445188 1062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.431233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:44903 (local address 127.30.78.66:59309)
0809 06:31:35.435730 (+ 4497us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.435747 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.435894 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.436571 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.436576 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.436601 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:35.437058 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.437075 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.438787 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.438792 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.441334 (+ 2542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.441349 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.443480 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.443487 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.443701 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.443737 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.444738 (+ 1001us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.444877 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4390,"thread_start_us":2811,"threads_started":1}
I20260809 06:31:35.445353 1010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.431814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:57037 (local address 127.30.78.65:36937)
0809 06:31:35.433218 (+ 1404us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.433224 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.433241 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:31:35.433293 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.433298 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.433361 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.433463 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:35.435434 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.436467 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.442920 (+ 6453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.444105 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.444242 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.444307 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.444925 (+ 618us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.445080 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1288}
I20260809 06:31:35.446014 1063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.430853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:36937 (local address 127.30.78.66:57037)
0809 06:31:35.432616 (+ 1763us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.432633 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.432758 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.434749 (+ 1991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.434754 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.434782 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:35.435264 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.435279 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.436758 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.436763 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.442709 (+ 5946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.442726 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.444548 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.444555 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.444723 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.444759 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.445551 (+ 792us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.445681 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1559,"thread_start_us":5700,"threads_started":1}
I20260809 06:31:35.446008 1034 raft_consensus.cc:686] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 LEADER]: Becoming Leader. State: Replica: bc9f706b145943f8a7aad6939c9ceb64, State: Running, Role: LEADER
I20260809 06:31:35.446282 912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5f139db0f841dfa933305469295473" candidate_uuid: "c1ae2ba0980a42509204c24fb365afc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "524b2e2cc3154c4e83f0043071b36a16" is_pre_election: true
I20260809 06:31:35.446630 912 raft_consensus.cc:2379] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c1ae2ba0980a42509204c24fb365afc8 in current term 1: Already voted for candidate bc9f706b145943f8a7aad6939c9ceb64 in this term.
I20260809 06:31:35.446750 493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f5f139db0f841dfa933305469295473" candidate_uuid: "c1ae2ba0980a42509204c24fb365afc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9f706b145943f8a7aad6939c9ceb64" is_pre_election: true
I20260809 06:31:35.447103 1034 consensus_queue.cc:237] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.447409 596 leader_election.cc:302] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c1ae2ba0980a42509204c24fb365afc8; no voters: 524b2e2cc3154c4e83f0043071b36a16, bc9f706b145943f8a7aad6939c9ceb64
I20260809 06:31:35.447829 1033 raft_consensus.cc:2726] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 06:31:35.450678 32727 catalog_manager.cc:5495] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc9f706b145943f8a7aad6939c9ceb64 (127.30.78.65). New cstate: current_term: 1 leader_uuid: "bc9f706b145943f8a7aad6939c9ceb64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } health_report { overall_health: UNKNOWN } } }
W20260809 06:31:35.491078 988 tablet.cc:2369] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:31:35.496750 778 tablet.cc:2369] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:31:35.506307 568 tablet.cc:2369] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 09 06:31:35 dist-test-slave-cvwc krb5kdc[32671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257093, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:35.524029 1076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.508260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36391 (local address 127.0.0.1:54880)
0809 06:31:35.508939 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.508959 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.509102 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.509527 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.509532 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.510380 (+ 848us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:35.510722 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.510735 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.512146 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.512152 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.513762 (+ 1610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.513778 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.514767 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.514772 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.514902 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.515640 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:35.515663 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:35.518047 (+ 2384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:35.521640 (+ 3593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:35.521650 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:35.521655 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:35.522077 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:35.522490 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:35.522493 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:35.522496 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:35.522624 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:35.523257 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:35.523262 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:35.523423 (+ 161us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.523544 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.523721 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":359,"threads_started":1}
I20260809 06:31:35.524528 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.508129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54880 (local address 127.30.78.126:36391)
0809 06:31:35.508303 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.508309 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.509055 (+ 746us) server_negotiation.cc:407] Connection header received
0809 06:31:35.509229 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.509234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.509347 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.509458 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:35.510904 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.512017 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.513924 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.514608 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.514724 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.518218 (+ 3494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:35.518225 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:35.518230 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:35.518265 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:35.521509 (+ 3244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:35.522208 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:35.522214 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:35.522217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:35.522385 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:35.522748 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:35.522753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:35.522756 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:35.523136 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:35.523290 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.523714 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.523945 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:31:35.529805 32727 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:54880:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 06:31:35.531064 32727 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:31:35.537861 461 tablet_service.cc:1467] Processing CreateTablet for tablet 2adf62c9c7914ad9898ae914d8c2ccc5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=029a2b9f163c4ba8a124d84a28936d73]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:31:35.538053 669 tablet_service.cc:1467] Processing CreateTablet for tablet 2adf62c9c7914ad9898ae914d8c2ccc5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=029a2b9f163c4ba8a124d84a28936d73]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:31:35.538481 461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2adf62c9c7914ad9898ae914d8c2ccc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:35.538664 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2adf62c9c7914ad9898ae914d8c2ccc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:35.544238 1020 tablet_bootstrap.cc:492] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: Bootstrap starting.
I20260809 06:31:35.544338 887 tablet_service.cc:1467] Processing CreateTablet for tablet 2adf62c9c7914ad9898ae914d8c2ccc5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=029a2b9f163c4ba8a124d84a28936d73]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:31:35.544921 887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2adf62c9c7914ad9898ae914d8c2ccc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:35.545847 1021 tablet_bootstrap.cc:492] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: Bootstrap starting.
I20260809 06:31:35.545989 1020 tablet_bootstrap.cc:654] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:35.547588 1021 tablet_bootstrap.cc:654] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:35.554669 1018 tablet_bootstrap.cc:492] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: Bootstrap starting.
I20260809 06:31:35.556502 1020 tablet_bootstrap.cc:492] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: No bootstrap required, opened a new log
I20260809 06:31:35.556598 1018 tablet_bootstrap.cc:654] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:35.556672 1020 ts_tablet_manager.cc:1397] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260809 06:31:35.557248 1020 raft_consensus.cc:348] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.557454 1020 raft_consensus.cc:374] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:35.557528 1020 raft_consensus.cc:729] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9f706b145943f8a7aad6939c9ceb64, State: Initialized, Role: FOLLOWER
I20260809 06:31:35.557801 1020 consensus_queue.cc:260] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.558269 1034 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.558583 1034 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:35.559125 1021 tablet_bootstrap.cc:492] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: No bootstrap required, opened a new log
I20260809 06:31:35.559294 1021 ts_tablet_manager.cc:1397] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.002s
I20260809 06:31:35.559716 1020 ts_tablet_manager.cc:1428] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 06:31:35.560045 1021 raft_consensus.cc:348] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.560297 1021 raft_consensus.cc:374] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:35.560398 1021 raft_consensus.cc:729] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ae2ba0980a42509204c24fb365afc8, State: Initialized, Role: FOLLOWER
I20260809 06:31:35.560652 1021 consensus_queue.cc:260] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.561307 1021 ts_tablet_manager.cc:1428] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 06:31:35.561174 1033 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.561473 1033 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:35.566978 1018 tablet_bootstrap.cc:492] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: No bootstrap required, opened a new log
I20260809 06:31:35.567145 1018 ts_tablet_manager.cc:1397] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
I20260809 06:31:35.567939 1018 raft_consensus.cc:348] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.568207 1018 raft_consensus.cc:374] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:35.568320 1018 raft_consensus.cc:729] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 524b2e2cc3154c4e83f0043071b36a16, State: Initialized, Role: FOLLOWER
I20260809 06:31:35.568605 1018 consensus_queue.cc:260] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.569159 1018 ts_tablet_manager.cc:1428] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260809 06:31:35.569041 1029 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.569379 1029 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:35.868505 1029 raft_consensus.cc:482] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:35.868700 1029 raft_consensus.cc:504] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.869313 1029 leader_election.cc:288] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc9f706b145943f8a7aad6939c9ceb64 (127.30.78.65:36937), c1ae2ba0980a42509204c24fb365afc8 (127.30.78.66:39195)
I20260809 06:31:35.869943 697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2adf62c9c7914ad9898ae914d8c2ccc5" candidate_uuid: "524b2e2cc3154c4e83f0043071b36a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ae2ba0980a42509204c24fb365afc8" is_pre_election: true
I20260809 06:31:35.869944 493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2adf62c9c7914ad9898ae914d8c2ccc5" candidate_uuid: "524b2e2cc3154c4e83f0043071b36a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9f706b145943f8a7aad6939c9ceb64" is_pre_election: true
I20260809 06:31:35.870199 493 raft_consensus.cc:2454] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 524b2e2cc3154c4e83f0043071b36a16 in term 0.
I20260809 06:31:35.870229 697 raft_consensus.cc:2454] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 524b2e2cc3154c4e83f0043071b36a16 in term 0.
I20260809 06:31:35.870664 804 leader_election.cc:302] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 524b2e2cc3154c4e83f0043071b36a16, bc9f706b145943f8a7aad6939c9ceb64, c1ae2ba0980a42509204c24fb365afc8; no voters:
I20260809 06:31:35.870966 1029 raft_consensus.cc:2781] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:35.871055 1029 raft_consensus.cc:482] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:35.871155 1029 raft_consensus.cc:3037] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:35.873198 1029 raft_consensus.cc:504] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.873744 1029 leader_election.cc:288] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [CANDIDATE]: Term 1 election: Requested vote from peers bc9f706b145943f8a7aad6939c9ceb64 (127.30.78.65:36937), c1ae2ba0980a42509204c24fb365afc8 (127.30.78.66:39195)
I20260809 06:31:35.874142 493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2adf62c9c7914ad9898ae914d8c2ccc5" candidate_uuid: "524b2e2cc3154c4e83f0043071b36a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9f706b145943f8a7aad6939c9ceb64"
I20260809 06:31:35.874194 697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2adf62c9c7914ad9898ae914d8c2ccc5" candidate_uuid: "524b2e2cc3154c4e83f0043071b36a16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1ae2ba0980a42509204c24fb365afc8"
I20260809 06:31:35.874382 493 raft_consensus.cc:3037] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:35.874402 697 raft_consensus.cc:3037] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:35.877156 697 raft_consensus.cc:2454] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 524b2e2cc3154c4e83f0043071b36a16 in term 1.
I20260809 06:31:35.877161 493 raft_consensus.cc:2454] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 524b2e2cc3154c4e83f0043071b36a16 in term 1.
I20260809 06:31:35.877641 804 leader_election.cc:302] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 524b2e2cc3154c4e83f0043071b36a16, bc9f706b145943f8a7aad6939c9ceb64, c1ae2ba0980a42509204c24fb365afc8; no voters:
I20260809 06:31:35.877936 1029 raft_consensus.cc:2781] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:35.878280 1029 raft_consensus.cc:686] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 LEADER]: Becoming Leader. State: Replica: 524b2e2cc3154c4e83f0043071b36a16, State: Running, Role: LEADER
I20260809 06:31:35.878517 1029 consensus_queue.cc:237] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } }
I20260809 06:31:35.880149 1082 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: TxnStatusTablet state changed. Reason: New leader 524b2e2cc3154c4e83f0043071b36a16. Latest consensus state: current_term: 1 leader_uuid: "524b2e2cc3154c4e83f0043071b36a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.880452 1082 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:31:35.881636 1086 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 06:31:35.881968 1086 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 06:31:35.881732 32728 catalog_manager.cc:5495] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 reported cstate change: term changed from 0 to 1, leader changed from <none> to 524b2e2cc3154c4e83f0043071b36a16 (127.30.78.67). New cstate: current_term: 1 leader_uuid: "524b2e2cc3154c4e83f0043071b36a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } health_report { overall_health: HEALTHY } } }
I20260809 06:31:35.924667 1064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.919218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38932 (local address 127.30.78.67:44903)
0809 06:31:35.919468 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.919472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.919489 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:31:35.919741 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.919746 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.919813 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.919885 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:35.920336 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.921095 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.922987 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.923454 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.923552 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.924050 (+ 498us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:35.924158 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:35.924231 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.924395 (+ 164us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.924460 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260809 06:31:35.924837 1076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.919156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:44903 (local address 127.0.0.1:38932)
0809 06:31:35.919406 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.919428 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.919568 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.919945 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.919950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.919963 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:31:35.920179 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.920190 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.921226 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.921232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.922855 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.922872 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.923606 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.923613 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:35.923820 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.923893 (+ 73us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:31:35.924254 (+ 361us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:31:35.924275 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 06:31:35.924363 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 06:31:35.924521 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 06:31:35.928902 697 raft_consensus.cc:1261] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Refusing update from remote peer 524b2e2cc3154c4e83f0043071b36a16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:35.928978 493 raft_consensus.cc:1261] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 FOLLOWER]: Refusing update from remote peer 524b2e2cc3154c4e83f0043071b36a16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:35.929557 1082 consensus_queue.cc:1035] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:35.929937 1029 consensus_queue.cc:1035] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:35.933276 1034 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: TxnStatusTablet state changed. Reason: New leader 524b2e2cc3154c4e83f0043071b36a16. Latest consensus state: current_term: 1 leader_uuid: "524b2e2cc3154c4e83f0043071b36a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.933583 1034 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:35.936211 1033 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: TxnStatusTablet state changed. Reason: New leader 524b2e2cc3154c4e83f0043071b36a16. Latest consensus state: current_term: 1 leader_uuid: "524b2e2cc3154c4e83f0043071b36a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.936480 1033 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:35.938715 1096 mvcc.cc:205] Tried to move back new op lower bound from 7316509064919187456 to 7316509064720506880. Current Snapshot: MvccSnapshot[applied={T|T < 7316509064919187456}]
I20260809 06:31:35.943413 1092 mvcc.cc:205] Tried to move back new op lower bound from 7316509064919187456 to 7316509064720506880. Current Snapshot: MvccSnapshot[applied={T|T < 7316509064919187456}]
I20260809 06:31:35.948400 1082 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "524b2e2cc3154c4e83f0043071b36a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.949306 1082 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:31:35.948932 1102 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "524b2e2cc3154c4e83f0043071b36a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.949517 1102 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P 524b2e2cc3154c4e83f0043071b36a16: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:31:35.951417 1033 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "524b2e2cc3154c4e83f0043071b36a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.951660 1033 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P c1ae2ba0980a42509204c24fb365afc8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:35.959527 1107 consensus_queue.cc:1035] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:35.959709 1034 tablet_replica.cc:439] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "524b2e2cc3154c4e83f0043071b36a16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc9f706b145943f8a7aad6939c9ceb64" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36937 } } peers { permanent_uuid: "c1ae2ba0980a42509204c24fb365afc8" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39195 } } peers { permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 } } }
I20260809 06:31:35.960005 1034 tablet_replica.cc:442] T 2adf62c9c7914ad9898ae914d8c2ccc5 P bc9f706b145943f8a7aad6939c9ceb64: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:35.981067 1107 consensus_queue.cc:1035] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "524b2e2cc3154c4e83f0043071b36a16" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 44903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:35.986004 1115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.962974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47382 (local address 127.30.78.65:36937)
0809 06:31:35.975412 (+ 12438us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.975419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.977195 (+ 1776us) server_negotiation.cc:407] Connection header received
0809 06:31:35.977538 (+ 343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.977544 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.977660 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.977898 (+ 238us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:35.978874 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.979965 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.981695 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.983800 (+ 2105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.983919 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:35.984528 (+ 609us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:35.985250 (+ 722us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:35.985396 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:35.985581 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 06:31:35.985661 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12291,"thread_start_us":12464,"threads_started":1}
I20260809 06:31:36.002679 1064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.995390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:44125 (local address 127.30.78.67:44903)
0809 06:31:35.995709 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:35.995715 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:35.996064 (+ 349us) server_negotiation.cc:407] Connection header received
0809 06:31:35.996246 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:35.996251 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:35.996319 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:35.996402 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:35.996816 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.998065 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.000507 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.001164 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.001252 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:36.001921 (+ 669us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:36.002045 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:36.002105 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:36.002297 (+ 192us) server_negotiation.cc:299] Negotiation successful
0809 06:31:36.002396 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188}
I20260809 06:31:36.003352 1121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:35.995400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:44903 (local address 127.30.78.65:44125)
0809 06:31:35.995972 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:35.995987 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:35.996112 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:35.996417 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:35.996422 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:35.996434 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:31:35.996686 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:35.996694 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:35.998580 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:35.998586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:36.000333 (+ 1747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:36.000349 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.001425 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.001431 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:36.001639 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:36.001700 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:31:36.002178 (+ 478us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:31:36.002187 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 06:31:36.002850 (+ 663us) client_negotiation.cc:240] Negotiation successful
0809 06:31:36.002988 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":322,"threads_started":1}
I20260809 06:31:36.060158 1115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:36.053110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:49319 (local address 127.30.78.65:36937)
0809 06:31:36.053296 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:36.053303 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:36.053747 (+ 444us) server_negotiation.cc:407] Connection header received
0809 06:31:36.053946 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:36.053950 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:36.054009 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:36.054079 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:36.054761 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.055677 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.057825 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.058387 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.058541 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:36.059361 (+ 820us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:36.059489 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:36.059554 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:36.059785 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 06:31:36.059869 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 06:31:36.060843 1126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:36.053028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:36937 (local address 127.30.78.67:49319)
0809 06:31:36.053629 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:36.053648 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:36.053828 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:36.054112 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:36.054117 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:36.054130 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:31:36.054523 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:36.054535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.055805 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.055811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:36.057655 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:36.057671 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.058861 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.058868 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:36.059080 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:36.059151 (+ 71us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:31:36.059633 (+ 482us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:31:36.059654 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 06:31:36.060341 (+ 687us) client_negotiation.cc:240] Negotiation successful
0809 06:31:36.060480 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":293,"threads_started":1}
I20260809 06:31:36.100172 32727 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:36.100455 32727 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:36.104012 32727 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 451e4c3ea26444779ebaa435826e6951: Sending DeleteTablet for 3 replicas of tablet 9f5f139db0f841dfa933305469295473
I20260809 06:31:36.104832 461 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5f139db0f841dfa933305469295473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:36 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:47380
I20260809 06:31:36.105089 669 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5f139db0f841dfa933305469295473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:36 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:58970
I20260809 06:31:36.107858 887 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f5f139db0f841dfa933305469295473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:36 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:38906
I20260809 06:31:36.115717 1131 tablet_replica.cc:330] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: stopping tablet replica
I20260809 06:31:36.115926 1131 raft_consensus.cc:2229] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:36.116147 1131 raft_consensus.cc:2258] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:36.117479 1131 ts_tablet_manager.cc:1905] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:36.122152 1130 tablet_replica.cc:330] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: stopping tablet replica
I20260809 06:31:36.122357 1130 raft_consensus.cc:2229] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:31:36.122952 1130 raft_consensus.cc:2258] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:36.124056 1130 ts_tablet_manager.cc:1905] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:36.125058 1131 ts_tablet_manager.cc:1918] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:31:36.125188 1131 log.cc:1196] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/9f5f139db0f841dfa933305469295473
I20260809 06:31:36.125643 1131 ts_tablet_manager.cc:1939] T 9f5f139db0f841dfa933305469295473 P c1ae2ba0980a42509204c24fb365afc8: Deleting consensus metadata
I20260809 06:31:36.126660 32712 catalog_manager.cc:4841] TS c1ae2ba0980a42509204c24fb365afc8 (127.30.78.66:39195): tablet 9f5f139db0f841dfa933305469295473 (table test-table [id=91a36b5abb4a4c8d896a7f83ab77ecf1]) successfully deleted
I20260809 06:31:36.132282 1130 ts_tablet_manager.cc:1918] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:31:36.132421 1130 log.cc:1196] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/9f5f139db0f841dfa933305469295473
I20260809 06:31:36.132930 1130 ts_tablet_manager.cc:1939] T 9f5f139db0f841dfa933305469295473 P bc9f706b145943f8a7aad6939c9ceb64: Deleting consensus metadata
I20260809 06:31:36.133283 1133 tablet_replica.cc:330] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: stopping tablet replica
I20260809 06:31:36.133951 32709 catalog_manager.cc:4841] TS bc9f706b145943f8a7aad6939c9ceb64 (127.30.78.65:36937): tablet 9f5f139db0f841dfa933305469295473 (table test-table [id=91a36b5abb4a4c8d896a7f83ab77ecf1]) successfully deleted
I20260809 06:31:36.134142 1133 raft_consensus.cc:2229] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:36.134544 1133 raft_consensus.cc:2258] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:36.137183 1133 ts_tablet_manager.cc:1905] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:36.145023 1133 ts_tablet_manager.cc:1918] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:31:36.145239 1133 log.cc:1196] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/9f5f139db0f841dfa933305469295473
I20260809 06:31:36.145860 1133 ts_tablet_manager.cc:1939] T 9f5f139db0f841dfa933305469295473 P 524b2e2cc3154c4e83f0043071b36a16: Deleting consensus metadata
Aug 09 06:31:36 dist-test-slave-cvwc krb5kdc[32671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257095, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:31:36.147092 32708 catalog_manager.cc:4841] TS 524b2e2cc3154c4e83f0043071b36a16 (127.30.78.67:44903): tablet 9f5f139db0f841dfa933305469295473 (table test-table [id=91a36b5abb4a4c8d896a7f83ab77ecf1]) successfully deleted
I20260809 06:31:36.156057 1115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:36.135063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47388 (local address 127.30.78.65:36937)
0809 06:31:36.135294 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:36.135301 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:36.136482 (+ 1181us) server_negotiation.cc:407] Connection header received
0809 06:31:36.136755 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:36.136761 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:36.136852 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:36.136928 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:36.139070 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.140215 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.142161 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.142851 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.142948 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:36.148201 (+ 5253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:36.148218 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:36.148237 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:36.148281 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:36.152604 (+ 4323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.153382 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.153393 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.153397 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.153562 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.154018 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.154025 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.154029 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.154572 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:36.154974 (+ 402us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:36.155199 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 06:31:36.155438 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260809 06:31:36.157106 560 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47388
I20260809 06:31:36.186805 1141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:36.160952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54882 (local address 127.30.78.126:36391)
0809 06:31:36.170241 (+ 9289us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:36.170248 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:36.170272 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:31:36.170341 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:36.170346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:36.170433 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:36.170552 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:36.172363 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.173519 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.175277 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.175962 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.176108 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:36.179131 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:36.179139 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:36.179144 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:36.179191 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:36.183495 (+ 4304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.184280 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.184286 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.184290 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.184462 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.184894 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.184899 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.184903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.185282 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:36.185567 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:36.185921 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 06:31:36.186161 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9149,"thread_start_us":9001,"threads_started":1}
W20260809 06:31:36.187896 32727 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54882
I20260809 06:31:36.190384 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 359
I20260809 06:31:36.210085 1115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:36.191907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47402 (local address 127.30.78.65:36937)
0809 06:31:36.192708 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:36.192714 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:36.194201 (+ 1487us) server_negotiation.cc:407] Connection header received
0809 06:31:36.194358 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:36.194363 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:36.194440 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:36.194552 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:36.196106 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.197154 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.199020 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.199738 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.199873 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:36.202791 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:36.202802 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:36.202807 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:36.202851 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:36.206677 (+ 3826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.207567 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.207573 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.207577 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.207738 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.208149 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.208154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.208157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.208582 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:36.208884 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:36.209216 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 06:31:36.209494 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667}
W20260809 06:31:36.210793 560 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47402
W20260809 06:31:36.211418 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 359: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:31:36.211630 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 359
I20260809 06:31:36.234222 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 571
Aug 09 06:31:36 dist-test-slave-cvwc krb5kdc[32671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257095, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:31:36.252027 1143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:36.235019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58982 (local address 127.30.78.66:39195)
0809 06:31:36.235563 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:36.235567 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:36.235586 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:31:36.235645 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:36.235649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:36.235722 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:36.235824 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:36.237384 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.238275 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.240069 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.240560 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.240662 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:36.245378 (+ 4716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:36.245395 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:36.245415 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:36.245464 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:36.249201 (+ 3737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.249963 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.249974 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.249977 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.250146 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.250474 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.250479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.250482 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.250946 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:36.251256 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:36.251413 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 06:31:36.251639 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":291,"threads_started":1}
W20260809 06:31:36.252843 769 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58982
W20260809 06:31:36.253530 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 571: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:31:36.253690 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 571
I20260809 06:31:36.280956 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 784
Aug 09 06:31:36 dist-test-slave-cvwc krb5kdc[32671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257095, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:31:36.296290 1064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:36.281675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38938 (local address 127.30.78.67:44903)
0809 06:31:36.281906 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:36.281913 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:36.281968 (+ 55us) server_negotiation.cc:407] Connection header received
0809 06:31:36.282169 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:36.282173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:36.282250 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:36.282347 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:36.283543 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.284320 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.285506 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:36.286116 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:36.286231 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:36.290472 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:36.290488 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:36.290504 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:36.290548 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:36.293466 (+ 2918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.294290 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.294297 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.294299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.294460 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:36.294870 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:36.294873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:36.294881 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:36.295269 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:36.295505 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:36.295837 (+ 332us) server_negotiation.cc:299] Negotiation successful
0809 06:31:36.296018 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
W20260809 06:31:36.296998 980 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38938
W20260809 06:31:36.297787 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 784: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:31:36.297935 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 784
I20260809 06:31:36.336951 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32688
I20260809 06:31:36.338076 316 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:36.450359 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 32688
2026-08-09T06:31:36Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4814 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:31:36 dist-test-slave-cvwc krb5kdc[1149](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:31:36 dist-test-slave-cvwc krb5kdc[1149](info): set up 2 sockets
Aug 09 06:31:36 dist-test-slave-cvwc krb5kdc[1149](info): commencing operation
krb5kdc: starting...
W20260809 06:31:37.629043 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.006s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:31:37 dist-test-slave-cvwc krb5kdc[1149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:31:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:31:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:31:37.796350 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36361
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:39273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:36361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:38.103323 1165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:38.103586 1165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:38.103681 1165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:38.110577 1165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:31:38.110666 1165 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 06:31:38.110711 1165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:38.110769 1165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:38.110817 1165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:31:38.110881 1165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:31:38.120172 1165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:36361
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:38.121320 1165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:38.122543 1165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:38.133325 1174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:38.133287 1176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:38.133378 1180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:38.134131 1165 server_base.cc:1034] running on GCE node
I20260809 06:31:38.134843 1165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:38.136050 1165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:38.137259 1165 hybrid_clock.cc:648] HybridClock initialized: now 1786257098137195 us; error 43 us; skew 500 ppm
I20260809 06:31:38.137550 1165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:38 dist-test-slave-cvwc krb5kdc[1149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257098, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:38.140396 1165 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:31:38.141611 1165 webserver.cc:460] Webserver started at http://127.30.78.126:35865/ using document root <none> and password file <none>
I20260809 06:31:38.142253 1165 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:38.142349 1165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:38.142638 1165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:38.145303 1165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca"
format_stamp: "Formatted at 2026-08-09 06:31:38 on dist-test-slave-cvwc"
server_key: "f3860926d6391a0ba88490d1b19fe0bb"
server_key_iv: "77d2a4564d136e4212e413722cf83a0b"
server_key_version: "encryptionkey@0"
I20260809 06:31:38.146056 1165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca"
format_stamp: "Formatted at 2026-08-09 06:31:38 on dist-test-slave-cvwc"
server_key: "f3860926d6391a0ba88490d1b19fe0bb"
server_key_iv: "77d2a4564d136e4212e413722cf83a0b"
server_key_version: "encryptionkey@0"
I20260809 06:31:38.150650 1165 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:31:38.153702 1196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:38.154911 1165 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 06:31:38.155061 1165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca"
format_stamp: "Formatted at 2026-08-09 06:31:38 on dist-test-slave-cvwc"
server_key: "f3860926d6391a0ba88490d1b19fe0bb"
server_key_iv: "77d2a4564d136e4212e413722cf83a0b"
server_key_version: "encryptionkey@0"
I20260809 06:31:38.155242 1165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:38.188391 1165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:38.192061 1165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:38.192298 1165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:38.211583 1165 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:36361
I20260809 06:31:38.211608 1280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:36361 every 8 connection(s)
I20260809 06:31:38.212901 1165 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:31:38.216495 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:38.220260 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1165
I20260809 06:31:38.220439 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:31:38.221066 31033 external_mini_cluster.cc:1428] Setting key d9ac230cfc13302182aebafb9bb5ca91
I20260809 06:31:38.228096 1283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca: Bootstrap starting.
I20260809 06:31:38.231551 1283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:38.232787 1283 log.cc:824] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:38.235450 1283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca: No bootstrap required, opened a new log
Aug 09 06:31:38 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:38.244874 1286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:38.222910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43362 (local address 127.30.78.126:36361)
0809 06:31:38.223713 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:38.223728 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:38.223775 (+ 47us) server_negotiation.cc:407] Connection header received
0809 06:31:38.226444 (+ 2669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:38.226472 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:38.226927 (+ 455us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:38.227327 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:38.228559 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.230528 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.231672 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.232675 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.232851 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:38.236837 (+ 3986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:38.236847 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:38.236867 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:38.236912 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:38.240728 (+ 3816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:38.241320 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:38.241328 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:38.241337 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:38.241556 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:38.241895 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:38.241900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:38.241903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:38.242596 (+ 693us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:38.242852 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:38.243180 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 06:31:38.243616 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":327,"threads_started":1}
I20260809 06:31:38.245469 1283 raft_consensus.cc:348] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36361 } }
I20260809 06:31:38.245818 1283 raft_consensus.cc:374] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:38.245919 1283 raft_consensus.cc:729] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de0f7d073dcc4c5381e4d2c7dba4ffca, State: Initialized, Role: FOLLOWER
I20260809 06:31:38.246451 1283 consensus_queue.cc:260] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36361 } }
I20260809 06:31:38.246678 1283 raft_consensus.cc:388] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:31:38.246814 1283 raft_consensus.cc:482] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:31:38.246991 1283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:38.248991 1283 raft_consensus.cc:504] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36361 } }
I20260809 06:31:38.249449 1283 leader_election.cc:302] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: de0f7d073dcc4c5381e4d2c7dba4ffca; no voters:
I20260809 06:31:38.249969 1283 leader_election.cc:288] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:31:38.250058 1288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:38.250703 1288 raft_consensus.cc:686] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [term 1 LEADER]: Becoming Leader. State: Replica: de0f7d073dcc4c5381e4d2c7dba4ffca, State: Running, Role: LEADER
I20260809 06:31:38.251187 1288 consensus_queue.cc:237] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36361 } }
I20260809 06:31:38.251852 1283 sys_catalog.cc:564] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:31:38.253603 1295 sys_catalog.cc:455] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [sys.catalog]: SysCatalogTable state changed. Reason: New leader de0f7d073dcc4c5381e4d2c7dba4ffca. Latest consensus state: current_term: 1 leader_uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36361 } } }
I20260809 06:31:38.253793 1289 sys_catalog.cc:455] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "de0f7d073dcc4c5381e4d2c7dba4ffca" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36361 } } }
I20260809 06:31:38.254050 1295 sys_catalog.cc:458] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:38.254137 1289 sys_catalog.cc:458] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:38.255359 1307 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:31:38.260478 1307 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:31:38.271224 1307 catalog_manager.cc:1347] Generated new cluster ID: ea7736397fe34e259fd4817fd6cfb91b
I20260809 06:31:38.271334 1307 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:31:38.284091 1307 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:31:38.285343 1307 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:31:38.295457 1307 catalog_manager.cc:5868] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca: Generated new TSK 0
I20260809 06:31:38.296203 1307 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:31:38.350768 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36361
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:39273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:38.675133 1330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:38.675467 1330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:38.675586 1330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:38.682480 1330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:38.682577 1330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:38.682664 1330 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 06:31:38.682715 1330 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:31:38.682781 1330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:31:38.692054 1330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.78.126:36361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:38.693259 1330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:38.694509 1330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:38.706529 1339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:38.706591 1337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:38.706614 1342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:38.707342 1330 server_base.cc:1034] running on GCE node
I20260809 06:31:38.707861 1330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:38.708679 1330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:38.709858 1330 hybrid_clock.cc:648] HybridClock initialized: now 1786257098709809 us; error 39 us; skew 500 ppm
I20260809 06:31:38.710124 1330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:38 dist-test-slave-cvwc krb5kdc[1149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257098, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:38.712999 1330 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:31:38.714300 1330 webserver.cc:460] Webserver started at http://127.30.78.65:33069/ using document root <none> and password file <none>
I20260809 06:31:38.714891 1330 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:38.714987 1330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:38.715232 1330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:38.718063 1330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "0812009ac45044869e464cb3b6d4d245"
format_stamp: "Formatted at 2026-08-09 06:31:38 on dist-test-slave-cvwc"
server_key: "cc5a180614a97435bd1873c7e8d5bdb4"
server_key_iv: "53d369eae7b58ae8fce50971b5b58d5e"
server_key_version: "encryptionkey@0"
I20260809 06:31:38.718735 1330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "0812009ac45044869e464cb3b6d4d245"
format_stamp: "Formatted at 2026-08-09 06:31:38 on dist-test-slave-cvwc"
server_key: "cc5a180614a97435bd1873c7e8d5bdb4"
server_key_iv: "53d369eae7b58ae8fce50971b5b58d5e"
server_key_version: "encryptionkey@0"
I20260809 06:31:38.723500 1330 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:31:38.726583 1352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:38.727717 1330 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:31:38.727847 1330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "0812009ac45044869e464cb3b6d4d245"
format_stamp: "Formatted at 2026-08-09 06:31:38 on dist-test-slave-cvwc"
server_key: "cc5a180614a97435bd1873c7e8d5bdb4"
server_key_iv: "53d369eae7b58ae8fce50971b5b58d5e"
server_key_version: "encryptionkey@0"
I20260809 06:31:38.728003 1330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:38.739077 1330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:38.742378 1330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:38.742595 1330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:38.744886 1330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:38.745002 1330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:38.745108 1330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:38.745198 1330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:31:38 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257098, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:38.766072 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:38.745687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:38151 (local address 127.30.78.126:36361)
0809 06:31:38.746130 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:38.746135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:38.746911 (+ 776us) server_negotiation.cc:407] Connection header received
0809 06:31:38.748732 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:38.748737 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:38.748823 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:38.748927 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:38.750821 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.751932 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.754475 (+ 2543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.754878 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.754991 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:38.759441 (+ 4450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:38.759448 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:38.759452 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:38.759494 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:38.762240 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:38.763247 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:38.763253 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:38.763256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:38.763388 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:38.763969 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:38.763973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:38.763975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:38.764299 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:38.764452 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:38.765383 (+ 931us) server_negotiation.cc:299] Negotiation successful
0809 06:31:38.765638 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":217,"threads_started":1}
I20260809 06:31:38.766882 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:38.746024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36361 (local address 127.30.78.65:38151)
0809 06:31:38.746769 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:38.746804 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:38.748478 (+ 1674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:38.749165 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:38.749172 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:38.749842 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:38.750562 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:38.750581 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.752088 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.752094 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:38.754255 (+ 2161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:38.754281 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.755123 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.755131 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:38.755410 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:38.756107 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:38.756141 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:38.759145 (+ 3004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:38.762386 (+ 3241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:38.762396 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:38.762410 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:38.763100 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:38.763504 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:38.763509 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:38.763513 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:38.763819 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:38.764516 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:38.764522 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:38.764962 (+ 440us) client_negotiation.cc:769] Sending connection context
0809 06:31:38.765243 (+ 281us) client_negotiation.cc:240] Negotiation successful
0809 06:31:38.765684 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":348,"threads_started":1}
I20260809 06:31:38.784850 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:38.772028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:57625 (local address 127.30.78.126:36361)
0809 06:31:38.772166 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:38.772170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:38.772813 (+ 643us) server_negotiation.cc:407] Connection header received
0809 06:31:38.772981 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:38.772989 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:38.773045 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:38.773118 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:38.774026 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.774706 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.775955 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.776379 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.776483 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:38.778902 (+ 2419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:38.778909 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:38.778915 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:38.778954 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:38.782042 (+ 3088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:38.782806 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:38.782812 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:38.782816 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:38.782973 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:38.783427 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:38.783432 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:38.783436 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:38.783747 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:38.783896 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:38.784283 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 06:31:38.784508 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 06:31:38.785084 1464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:38.772174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36361 (local address 127.30.78.65:57625)
0809 06:31:38.772722 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:38.772737 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:38.772860 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:38.773154 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:38.773158 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:38.773582 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:38.773900 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:38.773910 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.774835 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.774840 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:38.775821 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:38.775832 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:38.776567 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:38.776577 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:38.776891 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:38.777601 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:38.777623 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:38.778682 (+ 1059us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:38.782181 (+ 3499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:38.782190 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:38.782194 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:38.782670 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:38.783123 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:38.783128 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:38.783132 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:38.783309 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:38.783866 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:38.783871 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:38.784055 (+ 184us) client_negotiation.cc:769] Sending connection context
0809 06:31:38.784183 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 06:31:38.784545 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":307,"threads_started":1}
I20260809 06:31:38.793642 1330 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:32883
I20260809 06:31:38.793699 1533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:32883 every 8 connection(s)
I20260809 06:31:38.794801 1330 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:31:38.796589 1534 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36361
I20260809 06:31:38.796779 1534 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:38.797369 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1330
I20260809 06:31:38.797508 1534 heartbeater.cc:511] Master 127.30.78.126:36361 requested a full tablet report, sending...
I20260809 06:31:38.797581 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:31:38.798398 31033 external_mini_cluster.cc:1428] Setting key e670322c3e835e1f973259edc2ff979e
I20260809 06:31:38.799532 1216 ts_manager.cc:194] Registered new tserver with Master: 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883)
I20260809 06:31:38.800997 1216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:38151
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:31:38.834815 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36361
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:39273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:39.150998 1542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:39.151273 1542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:39.151412 1542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:39.158470 1542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:39.158568 1542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:39.158689 1542 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 06:31:39.158748 1542 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:31:39.158849 1542 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:31:39.168398 1542 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.78.126:36361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:39.169588 1542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:39.170840 1542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:39.182622 1548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:39.182664 1553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:39.182684 1549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:39.183579 1542 server_base.cc:1034] running on GCE node
I20260809 06:31:39.184115 1542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:39.184939 1542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:39.186115 1542 hybrid_clock.cc:648] HybridClock initialized: now 1786257099186065 us; error 46 us; skew 500 ppm
I20260809 06:31:39.186390 1542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:39 dist-test-slave-cvwc krb5kdc[1149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257099, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:39.195317 1542 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:31:39.196707 1542 webserver.cc:460] Webserver started at http://127.30.78.66:44165/ using document root <none> and password file <none>
I20260809 06:31:39.197317 1542 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:39.197424 1542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:39.197680 1542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:39.200464 1542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "4e0c00453b1a4211aa718ac8b6a9432b"
format_stamp: "Formatted at 2026-08-09 06:31:39 on dist-test-slave-cvwc"
server_key: "0b3ab1f2abdc206d9e51c91846170bb0"
server_key_iv: "d1aebfec3412a4a787697485a0b8049c"
server_key_version: "encryptionkey@0"
I20260809 06:31:39.201164 1542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "4e0c00453b1a4211aa718ac8b6a9432b"
format_stamp: "Formatted at 2026-08-09 06:31:39 on dist-test-slave-cvwc"
server_key: "0b3ab1f2abdc206d9e51c91846170bb0"
server_key_iv: "d1aebfec3412a4a787697485a0b8049c"
server_key_version: "encryptionkey@0"
I20260809 06:31:39.206066 1542 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260809 06:31:39.209290 1563 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:39.210577 1542 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:31:39.210724 1542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "4e0c00453b1a4211aa718ac8b6a9432b"
format_stamp: "Formatted at 2026-08-09 06:31:39 on dist-test-slave-cvwc"
server_key: "0b3ab1f2abdc206d9e51c91846170bb0"
server_key_iv: "d1aebfec3412a4a787697485a0b8049c"
server_key_version: "encryptionkey@0"
I20260809 06:31:39.210916 1542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:39.238032 1542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:39.241593 1542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:39.241868 1542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:39.244427 1542 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:39.244549 1542 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:39.244669 1542 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:39.244740 1542 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:31:39 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257099, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:39.266189 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.244742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:46761 (local address 127.30.78.126:36361)
0809 06:31:39.244917 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.244922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.246333 (+ 1411us) server_negotiation.cc:407] Connection header received
0809 06:31:39.248260 (+ 1927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.248266 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.248382 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.248500 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:39.250262 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.251187 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.254084 (+ 2897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.254499 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.254601 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.259447 (+ 4846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:39.259455 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:39.259461 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:39.259505 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:39.262929 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.263777 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.263782 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.263784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.263961 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.264481 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.264486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.264490 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.264759 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:39.264910 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.265572 (+ 662us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.265845 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 06:31:39.267704 1578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.245369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36361 (local address 127.30.78.66:46761)
0809 06:31:39.246169 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.246205 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.247956 (+ 1751us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.248677 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.248684 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.249281 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:39.250088 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.250109 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.251384 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.251390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.253909 (+ 2519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.253930 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.254743 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.254750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.255097 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.255791 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:39.255823 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:39.259180 (+ 3357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:39.263064 (+ 3884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:39.263071 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:39.263081 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:39.263655 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:39.264106 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:39.264119 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:39.264122 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:39.264350 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:39.264900 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:39.264908 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:39.265206 (+ 298us) client_negotiation.cc:769] Sending connection context
0809 06:31:39.265443 (+ 237us) client_negotiation.cc:240] Negotiation successful
0809 06:31:39.266000 (+ 557us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":351,"threads_started":1}
I20260809 06:31:39.286417 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.273121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:49921 (local address 127.30.78.126:36361)
0809 06:31:39.273298 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.273304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.273866 (+ 562us) server_negotiation.cc:407] Connection header received
0809 06:31:39.274055 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.274060 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.274118 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.274191 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:39.275328 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.276024 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.277900 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.278379 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.278514 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.280833 (+ 2319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:39.280839 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:39.280844 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:39.280879 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:39.283773 (+ 2894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.284566 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.284572 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.284575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.284705 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.285047 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.285052 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.285056 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.285427 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:39.285572 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.286049 (+ 477us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.286199 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:31:39.286793 1669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.273132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36361 (local address 127.30.78.66:49921)
0809 06:31:39.273756 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.273776 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.273939 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.274236 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.274241 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.274828 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:39.275210 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.275222 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.276128 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.276133 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.277760 (+ 1627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.277776 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.278567 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.278574 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.278813 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.279457 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:39.279480 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:39.280639 (+ 1159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:39.283922 (+ 3283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:39.283925 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:39.283928 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:39.284458 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:39.284814 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:39.284818 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:39.284820 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:39.284946 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:39.285556 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:39.285562 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:39.285796 (+ 234us) client_negotiation.cc:769] Sending connection context
0809 06:31:39.285976 (+ 180us) client_negotiation.cc:240] Negotiation successful
0809 06:31:39.286319 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":317,"threads_started":1}
I20260809 06:31:39.295590 1542 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:44379
I20260809 06:31:39.295744 1743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:44379 every 8 connection(s)
I20260809 06:31:39.296808 1542 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:31:39.298700 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1542
I20260809 06:31:39.298702 1744 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36361
I20260809 06:31:39.298893 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:31:39.298934 1744 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:39.299458 31033 external_mini_cluster.cc:1428] Setting key 21109bd881f60a47b47be3326c3d219a
I20260809 06:31:39.299671 1744 heartbeater.cc:511] Master 127.30.78.126:36361 requested a full tablet report, sending...
I20260809 06:31:39.301005 1215 ts_manager.cc:194] Registered new tserver with Master: 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379)
I20260809 06:31:39.301883 1215 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:46761
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:31:39.336925 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36361
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:39273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:39.655817 1750 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:39.656206 1750 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:39.656391 1750 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:39.663982 1750 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:39.664093 1750 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:39.664237 1750 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260809 06:31:39.664319 1750 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:31:39.664422 1750 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:31:39.674288 1750 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.78.126:36361
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:39.675515 1750 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:39.676846 1750 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:39.689857 1759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:39.690124 1762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:39.689832 1760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:39.690351 1750 server_base.cc:1034] running on GCE node
I20260809 06:31:39.690982 1750 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:39.691836 1750 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:39.693025 1750 hybrid_clock.cc:648] HybridClock initialized: now 1786257099692985 us; error 31 us; skew 500 ppm
I20260809 06:31:39.693310 1750 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:39 dist-test-slave-cvwc krb5kdc[1149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257099, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:39.696305 1750 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:31:39.697686 1750 webserver.cc:460] Webserver started at http://127.30.78.67:36497/ using document root <none> and password file <none>
I20260809 06:31:39.698359 1750 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:39.698491 1750 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:39.698776 1750 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:39.701630 1750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "32809d37a9ae4150959b4a094c94fa46"
format_stamp: "Formatted at 2026-08-09 06:31:39 on dist-test-slave-cvwc"
server_key: "7333a3a2909e59dbeea33d9bd7455ce9"
server_key_iv: "1bf10842d40acc54354b50ee28c1d75d"
server_key_version: "encryptionkey@0"
I20260809 06:31:39.702405 1750 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "32809d37a9ae4150959b4a094c94fa46"
format_stamp: "Formatted at 2026-08-09 06:31:39 on dist-test-slave-cvwc"
server_key: "7333a3a2909e59dbeea33d9bd7455ce9"
server_key_iv: "1bf10842d40acc54354b50ee28c1d75d"
server_key_version: "encryptionkey@0"
I20260809 06:31:39.707324 1750 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:31:39.710628 1771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:39.711834 1750 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:31:39.711983 1750 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "32809d37a9ae4150959b4a094c94fa46"
format_stamp: "Formatted at 2026-08-09 06:31:39 on dist-test-slave-cvwc"
server_key: "7333a3a2909e59dbeea33d9bd7455ce9"
server_key_iv: "1bf10842d40acc54354b50ee28c1d75d"
server_key_version: "encryptionkey@0"
I20260809 06:31:39.712154 1750 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:39.727769 1750 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:39.731751 1750 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:39.732016 1750 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:39.734462 1750 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:39.734555 1750 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:39.734666 1750 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:39.734759 1750 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:31:39 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257099, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:39.758947 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.734936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:37779 (local address 127.30.78.126:36361)
0809 06:31:39.735153 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.735158 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.736504 (+ 1346us) server_negotiation.cc:407] Connection header received
0809 06:31:39.738568 (+ 2064us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.738574 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.738668 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.738760 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:39.740863 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.741951 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.744818 (+ 2867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.745362 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.745496 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.750121 (+ 4625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:39.750128 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:39.750133 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:39.750176 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:39.753220 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.754126 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.754130 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.754132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.754279 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.754933 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.754938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.754941 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.755320 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:39.755482 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.758304 (+ 2822us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.758583 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 06:31:39.760073 1784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.735437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36361 (local address 127.30.78.67:37779)
0809 06:31:39.736300 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.736343 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.738283 (+ 1940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.739170 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.739179 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.739847 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:39.740677 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.740714 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.742140 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.742146 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.744650 (+ 2504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.744668 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.745632 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.745640 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.745976 (+ 336us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.746685 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:39.746719 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:39.749903 (+ 3184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:39.753344 (+ 3441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:39.753352 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:39.753378 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:39.753968 (+ 590us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:39.754399 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:39.754404 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:39.754407 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:39.754742 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:39.755561 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:39.755568 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:39.756057 (+ 489us) client_negotiation.cc:769] Sending connection context
0809 06:31:39.756425 (+ 368us) client_negotiation.cc:240] Negotiation successful
0809 06:31:39.757029 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":354,"threads_started":1}
I20260809 06:31:39.779383 1750 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:39571
I20260809 06:31:39.779510 1961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:39571 every 8 connection(s)
I20260809 06:31:39.780777 1750 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:31:39.781314 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1750
I20260809 06:31:39.781497 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:31:39.782063 31033 external_mini_cluster.cc:1428] Setting key 59198988bab473f1c48917b1fd6f76c3
I20260809 06:31:39.783277 1963 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36361
I20260809 06:31:39.783522 1963 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:39.784415 1963 heartbeater.cc:511] Master 127.30.78.126:36361 requested a full tablet report, sending...
I20260809 06:31:39.785811 1216 ts_manager.cc:194] Registered new tserver with Master: 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571)
I20260809 06:31:39.786849 1216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:37779
I20260809 06:31:39.787284 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.772225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:39603 (local address 127.30.78.126:36361)
0809 06:31:39.772424 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.772429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.773110 (+ 681us) server_negotiation.cc:407] Connection header received
0809 06:31:39.773301 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.773307 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.773408 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.773513 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:39.774996 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.775689 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.777613 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.778046 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.778164 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.780366 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:39.780373 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:39.780387 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:39.780425 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:39.784097 (+ 3672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.785037 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.785043 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.785048 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.785204 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.785664 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.785669 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.785673 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.786078 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:39.786240 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.786701 (+ 461us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.786947 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:31:39.787318 1945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.772231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36361 (local address 127.30.78.67:39603)
0809 06:31:39.772983 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.773006 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.773168 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.773566 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.773570 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.774282 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:39.774831 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.774848 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.775833 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.775840 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.777486 (+ 1646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.777502 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.778427 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.778437 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.778654 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.779254 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:39.779278 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:39.780181 (+ 903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:39.784272 (+ 4091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:39.784278 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:39.784282 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:39.784865 (+ 583us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:39.785333 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:39.785338 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:39.785342 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:39.785516 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:39.786217 (+ 701us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:39.786222 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:39.786418 (+ 196us) client_negotiation.cc:769] Sending connection context
0809 06:31:39.786573 (+ 155us) client_negotiation.cc:240] Negotiation successful
0809 06:31:39.786883 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":366,"threads_started":1}
I20260809 06:31:39.797215 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:31:39.803876 1534 heartbeater.cc:503] Master 127.30.78.126:36361 was elected leader, sending a full tablet report...
Aug 09 06:31:39 dist-test-slave-cvwc krb5kdc[1149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 06:31:39 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:39.840857 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.828576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43376 (local address 127.30.78.126:36361)
0809 06:31:39.828794 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.828799 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.828888 (+ 89us) server_negotiation.cc:407] Connection header received
0809 06:31:39.829035 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.829039 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.829102 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.829185 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:39.830546 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.831338 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.832564 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.832971 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.833071 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.836557 (+ 3486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:39.836561 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:39.836565 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:39.836596 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:39.838890 (+ 2294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.839415 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.839418 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.839420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.839529 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:39.839793 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:39.839796 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:39.839798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:39.840051 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:39.840230 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.840432 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.840595 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 06:31:39.844610 1216 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:31:39.851399 1216 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:31:39.874212 1982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.862530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:44379 (local address 127.0.0.1:58772)
0809 06:31:39.865016 (+ 2486us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.865033 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.865142 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.866116 (+ 974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.866124 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.866166 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:39.866575 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.866588 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.868541 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.868547 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.871014 (+ 2467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.871033 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.873169 (+ 2136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.873176 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.873407 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.873468 (+ 61us) client_negotiation.cc:769] Sending connection context
0809 06:31:39.873602 (+ 134us) client_negotiation.cc:240] Negotiation successful
0809 06:31:39.873811 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2370,"thread_start_us":401,"threads_started":1}
I20260809 06:31:39.875891 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.863125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58772 (local address 127.30.78.66:44379)
0809 06:31:39.863980 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.863990 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.865258 (+ 1268us) server_negotiation.cc:407] Connection header received
0809 06:31:39.865371 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.865379 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.865641 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.865855 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:39.866790 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.868362 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.871216 (+ 2854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.872668 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.872804 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.873023 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.875368 (+ 2345us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.875577 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":525,"threads_started":1}
I20260809 06:31:39.879472 1638 tablet_service.cc:1467] Processing CreateTablet for tablet d1b725b7e41045eb855b7c2dbc49b509 (DEFAULT_TABLE table=test-table [id=3fc501bfa6184b11a165baafb4a9aab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:39.880630 1638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1b725b7e41045eb855b7c2dbc49b509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:39.883369 1986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.865079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:39571 (local address 127.0.0.1:52652)
0809 06:31:39.874843 (+ 9764us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.874862 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.874974 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.876371 (+ 1397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.876376 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.876402 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:39.876760 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.876772 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.878522 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.878527 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.880666 (+ 2139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.880684 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.882533 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.882540 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.882721 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.882754 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:31:39.882820 (+ 66us) client_negotiation.cc:240] Negotiation successful
0809 06:31:39.882952 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9637,"mutex_wait_us":4,"thread_start_us":9968,"threads_started":1}
I20260809 06:31:39.883507 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.862631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51694 (local address 127.30.78.65:32883)
0809 06:31:39.876151 (+ 13520us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.876160 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.876186 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:31:39.876278 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.876284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.876486 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.876713 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:39.877344 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.878818 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.881114 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.882104 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.882612 (+ 508us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.882818 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.883069 (+ 251us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.883229 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13288,"thread_start_us":13154,"threads_started":1}
I20260809 06:31:39.883535 1983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.862361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32883 (local address 127.0.0.1:51694)
0809 06:31:39.864230 (+ 1869us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.864279 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.864458 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.876726 (+ 12268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.876731 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.876757 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:39.877157 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.877170 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.879027 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.879032 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.880979 (+ 1947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.880989 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.882346 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.882357 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.882541 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.882925 (+ 384us) client_negotiation.cc:769] Sending connection context
0809 06:31:39.883016 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 06:31:39.883144 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1594,"mutex_wait_us":309,"thread_start_us":2363,"threads_started":1}
I20260809 06:31:39.884477 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.865382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52652 (local address 127.30.78.67:39571)
0809 06:31:39.875689 (+ 10307us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.875697 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.875733 (+ 36us) server_negotiation.cc:407] Connection header received
0809 06:31:39.875833 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.875841 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.876174 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.876378 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:39.877014 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.878357 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.880857 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.882286 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.883670 (+ 1384us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.883906 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.883990 (+ 84us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.884146 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10157,"thread_start_us":9985,"threads_started":1}
I20260809 06:31:39.887701 1428 tablet_service.cc:1467] Processing CreateTablet for tablet d1b725b7e41045eb855b7c2dbc49b509 (DEFAULT_TABLE table=test-table [id=3fc501bfa6184b11a165baafb4a9aab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:39.887825 1860 tablet_service.cc:1467] Processing CreateTablet for tablet d1b725b7e41045eb855b7c2dbc49b509 (DEFAULT_TABLE table=test-table [id=3fc501bfa6184b11a165baafb4a9aab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:39.888835 1428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1b725b7e41045eb855b7c2dbc49b509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:39.889183 1860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d1b725b7e41045eb855b7c2dbc49b509. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:39.895478 1988 tablet_bootstrap.cc:492] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: Bootstrap starting.
I20260809 06:31:39.899246 1988 tablet_bootstrap.cc:654] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:39.900508 1988 log.cc:824] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:39.905790 1988 tablet_bootstrap.cc:492] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: No bootstrap required, opened a new log
I20260809 06:31:39.906085 1988 ts_tablet_manager.cc:1397] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260809 06:31:39.906184 1992 tablet_bootstrap.cc:492] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: Bootstrap starting.
I20260809 06:31:39.909565 1990 tablet_bootstrap.cc:492] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: Bootstrap starting.
I20260809 06:31:39.909734 1992 tablet_bootstrap.cc:654] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:39.911557 1992 log.cc:824] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:39.913128 1990 tablet_bootstrap.cc:654] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:39.914110 1990 log.cc:824] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:39.915009 1992 tablet_bootstrap.cc:492] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: No bootstrap required, opened a new log
I20260809 06:31:39.915344 1992 ts_tablet_manager.cc:1397] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260809 06:31:39.916152 1988 raft_consensus.cc:348] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:39.916590 1988 raft_consensus.cc:374] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:39.916700 1988 raft_consensus.cc:729] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0c00453b1a4211aa718ac8b6a9432b, State: Initialized, Role: FOLLOWER
I20260809 06:31:39.916749 1990 tablet_bootstrap.cc:492] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: No bootstrap required, opened a new log
I20260809 06:31:39.916998 1990 ts_tablet_manager.cc:1397] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 06:31:39.917402 1988 consensus_queue.cc:260] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:39.918488 1744 heartbeater.cc:503] Master 127.30.78.126:36361 was elected leader, sending a full tablet report...
I20260809 06:31:39.919122 1988 ts_tablet_manager.cc:1428] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260809 06:31:39.925568 1992 raft_consensus.cc:348] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:39.926015 1992 raft_consensus.cc:374] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:39.926123 1992 raft_consensus.cc:729] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32809d37a9ae4150959b4a094c94fa46, State: Initialized, Role: FOLLOWER
I20260809 06:31:39.926717 1992 consensus_queue.cc:260] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:39.927691 1963 heartbeater.cc:503] Master 127.30.78.126:36361 was elected leader, sending a full tablet report...
I20260809 06:31:39.928036 1990 raft_consensus.cc:348] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:39.928412 1992 ts_tablet_manager.cc:1428] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: Time spent starting tablet: real 0.013s user 0.011s sys 0.002s
I20260809 06:31:39.928459 1990 raft_consensus.cc:374] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:39.928560 1990 raft_consensus.cc:729] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0812009ac45044869e464cb3b6d4d245, State: Initialized, Role: FOLLOWER
I20260809 06:31:39.929085 1990 consensus_queue.cc:260] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:39.930634 1990 ts_tablet_manager.cc:1428] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260809 06:31:39.940449 1996 raft_consensus.cc:482] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:39.940680 1996 raft_consensus.cc:504] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:39.942158 1996 leader_election.cc:288] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571)
I20260809 06:31:39.947992 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.942410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:52929 (local address 127.30.78.65:32883)
0809 06:31:39.942607 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.942614 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.943052 (+ 438us) server_negotiation.cc:407] Connection header received
0809 06:31:39.943232 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.943237 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.943319 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.943414 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:39.944007 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.944694 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.946406 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.947182 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.947328 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.947413 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.947661 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.947779 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:31:39.948105 1999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.942410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32883 (local address 127.30.78.66:52929)
0809 06:31:39.942952 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.942968 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.943106 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.943506 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.943510 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.943532 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:39.943876 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.943886 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.944815 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.944819 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.946256 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.946269 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.947386 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.947392 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.947521 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.947545 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:31:39.947625 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 06:31:39.947747 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":255,"threads_started":1}
I20260809 06:31:39.948570 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.943238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:45155 (local address 127.30.78.67:39571)
0809 06:31:39.943415 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.943420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.943714 (+ 294us) server_negotiation.cc:407] Connection header received
0809 06:31:39.943872 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.943877 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.943930 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.944000 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:39.944522 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.945197 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.946872 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.947708 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.947851 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.947920 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:39.948284 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 06:31:39.948400 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:31:39.949055 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.943031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:39571 (local address 127.30.78.66:45155)
0809 06:31:39.943617 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.943634 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.943753 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.944031 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.944035 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.944058 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:39.944368 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.944378 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.945333 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.945337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.946724 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.946738 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.947934 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.947941 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.948093 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.948128 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 06:31:39.948725 (+ 597us) client_negotiation.cc:240] Negotiation successful
0809 06:31:39.948828 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":308,"threads_started":1}
I20260809 06:31:39.948927 1466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1b725b7e41045eb855b7c2dbc49b509" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245" is_pre_election: true
I20260809 06:31:39.949352 1466 raft_consensus.cc:2454] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 0.
I20260809 06:31:39.949980 1570 leader_election.cc:302] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812009ac45044869e464cb3b6d4d245, 4e0c00453b1a4211aa718ac8b6a9432b; no voters:
I20260809 06:31:39.950032 1889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1b725b7e41045eb855b7c2dbc49b509" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32809d37a9ae4150959b4a094c94fa46" is_pre_election: true
I20260809 06:31:39.950387 1996 raft_consensus.cc:2781] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:39.950515 1996 raft_consensus.cc:482] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:39.950487 1889 raft_consensus.cc:2454] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 0.
I20260809 06:31:39.950614 1996 raft_consensus.cc:3037] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:39.952751 1996 raft_consensus.cc:504] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:39.953292 1996 leader_election.cc:288] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 election: Requested vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571)
I20260809 06:31:39.953675 1466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1b725b7e41045eb855b7c2dbc49b509" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245"
I20260809 06:31:39.953761 1889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d1b725b7e41045eb855b7c2dbc49b509" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32809d37a9ae4150959b4a094c94fa46"
I20260809 06:31:39.953922 1466 raft_consensus.cc:3037] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:39.953944 1889 raft_consensus.cc:3037] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:39.956991 1889 raft_consensus.cc:2454] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 1.
I20260809 06:31:39.956991 1466 raft_consensus.cc:2454] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 1.
I20260809 06:31:39.957331 1570 leader_election.cc:302] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812009ac45044869e464cb3b6d4d245, 4e0c00453b1a4211aa718ac8b6a9432b; no voters:
I20260809 06:31:39.957574 1996 raft_consensus.cc:2781] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:39.958039 1996 raft_consensus.cc:686] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 LEADER]: Becoming Leader. State: Replica: 4e0c00453b1a4211aa718ac8b6a9432b, State: Running, Role: LEADER
I20260809 06:31:39.958537 1996 consensus_queue.cc:237] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:39.962689 1215 catalog_manager.cc:5495] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66). New cstate: current_term: 1 leader_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } health_report { overall_health: UNKNOWN } } }
Aug 09 06:31:39 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257098, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:40.004165 2016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.991802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36361 (local address 127.0.0.1:43388)
0809 06:31:39.992349 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:39.992364 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:39.992478 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:39.992736 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:39.992739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:39.993381 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:39.993636 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.993645 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.994662 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.994665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.995671 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:39.995684 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.996391 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.996395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:39.996510 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.997059 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:39.997075 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:39.999175 (+ 2100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:40.001777 (+ 2602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:40.001787 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:40.001792 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:40.002190 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:40.002529 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:40.002534 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:40.002538 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:40.002667 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:40.003156 (+ 489us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:40.003164 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:40.003313 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.003449 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.003703 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":296,"threads_started":1}
I20260809 06:31:40.004166 1365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:39.991723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43388 (local address 127.30.78.126:36361)
0809 06:31:39.991918 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:39.991925 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:39.992438 (+ 513us) server_negotiation.cc:407] Connection header received
0809 06:31:39.992559 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:39.992563 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:39.992623 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:39.992697 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:39.993799 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.994536 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.995802 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:39.996232 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:39.996320 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:39.999344 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:39.999349 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:39.999352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:39.999382 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:40.001652 (+ 2270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:40.002293 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:40.002297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:40.002299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:40.002426 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:40.002774 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:40.002777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:40.002779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:40.003026 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:40.003172 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.003575 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.003840 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":63}
I20260809 06:31:40.008571 1215 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:43388:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 06:31:40.009562 1215 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:31:40.015632 1428 tablet_service.cc:1467] Processing CreateTablet for tablet 8ac19f6af1f4465dbdcbbafc3f92677d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=65db6454301f4e05898a507a3b86e512]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:31:40.015738 1638 tablet_service.cc:1467] Processing CreateTablet for tablet 8ac19f6af1f4465dbdcbbafc3f92677d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=65db6454301f4e05898a507a3b86e512]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:31:40.015923 1860 tablet_service.cc:1467] Processing CreateTablet for tablet 8ac19f6af1f4465dbdcbbafc3f92677d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=65db6454301f4e05898a507a3b86e512]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:31:40.016625 1638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ac19f6af1f4465dbdcbbafc3f92677d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:40.016676 1428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ac19f6af1f4465dbdcbbafc3f92677d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:40.016675 1860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ac19f6af1f4465dbdcbbafc3f92677d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:40.022120 1988 tablet_bootstrap.cc:492] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: Bootstrap starting.
I20260809 06:31:40.023427 1988 tablet_bootstrap.cc:654] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:40.023564 1992 tablet_bootstrap.cc:492] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: Bootstrap starting.
I20260809 06:31:40.023706 1990 tablet_bootstrap.cc:492] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: Bootstrap starting.
I20260809 06:31:40.025177 1992 tablet_bootstrap.cc:654] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:40.025287 1990 tablet_bootstrap.cc:654] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:40.026594 1988 tablet_bootstrap.cc:492] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: No bootstrap required, opened a new log
I20260809 06:31:40.026722 1988 ts_tablet_manager.cc:1397] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 06:31:40.027230 1992 tablet_bootstrap.cc:492] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: No bootstrap required, opened a new log
I20260809 06:31:40.027343 1992 ts_tablet_manager.cc:1397] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260809 06:31:40.027298 1988 raft_consensus.cc:348] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.027526 1988 raft_consensus.cc:374] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:40.027626 1988 raft_consensus.cc:729] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0c00453b1a4211aa718ac8b6a9432b, State: Initialized, Role: FOLLOWER
I20260809 06:31:40.027844 1988 consensus_queue.cc:260] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.028033 1992 raft_consensus.cc:348] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.028255 1992 raft_consensus.cc:374] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:40.028324 1990 tablet_bootstrap.cc:492] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: No bootstrap required, opened a new log
I20260809 06:31:40.028347 1992 raft_consensus.cc:729] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32809d37a9ae4150959b4a094c94fa46, State: Initialized, Role: FOLLOWER
I20260809 06:31:40.028450 1990 ts_tablet_manager.cc:1397] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260809 06:31:40.028436 1988 ts_tablet_manager.cc:1428] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 06:31:40.028306 1996 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.028594 1996 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:40.028550 1992 consensus_queue.cc:260] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.029129 1992 ts_tablet_manager.cc:1428] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 06:31:40.028990 1997 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.029357 1997 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:40.029129 1990 raft_consensus.cc:348] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.029626 1990 raft_consensus.cc:374] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:40.029752 1990 raft_consensus.cc:729] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0812009ac45044869e464cb3b6d4d245, State: Initialized, Role: FOLLOWER
I20260809 06:31:40.029990 1990 consensus_queue.cc:260] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.030416 1998 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.030748 1998 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:40.031116 1990 ts_tablet_manager.cc:1428] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20260809 06:31:40.038897 1965 tablet.cc:2369] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:31:40.046945 1535 tablet.cc:2369] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:31:40.048555 1746 tablet.cc:2369] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:31:40.108768 1998 raft_consensus.cc:482] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:40.109001 1998 raft_consensus.cc:504] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.110759 1998 leader_election.cc:288] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379), 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571)
I20260809 06:31:40.117465 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.111216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:56935 (local address 127.30.78.66:44379)
0809 06:31:40.111643 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.111649 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.111941 (+ 292us) server_negotiation.cc:407] Connection header received
0809 06:31:40.112135 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.112139 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.112200 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.112272 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:40.112850 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.113587 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.115753 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.116567 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.116718 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.116793 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.117090 (+ 297us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.117213 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275}
I20260809 06:31:40.117514 2024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.110988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:44379 (local address 127.30.78.65:56935)
0809 06:31:40.111825 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:40.111846 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:40.111995 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:40.112299 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:40.112303 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:40.112326 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:40.112692 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.112706 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.113735 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.113741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.115614 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.115626 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.116755 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.116761 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.116943 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.116967 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.117049 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.117178 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":466,"threads_started":1}
I20260809 06:31:40.117865 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.111143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:33767 (local address 127.30.78.67:39571)
0809 06:31:40.111339 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.111345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.112128 (+ 783us) server_negotiation.cc:407] Connection header received
0809 06:31:40.112287 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.112293 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.112371 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.112453 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:40.113032 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.113946 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.116088 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.116936 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.117070 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.117141 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.117458 (+ 317us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.117591 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:31:40.118134 2025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.111164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:39571 (local address 127.30.78.65:33767)
0809 06:31:40.112022 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:40.112036 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:40.112159 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:40.112496 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:40.112501 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:40.112524 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:40.112860 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.112869 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.114075 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.114083 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.115948 (+ 1865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.115961 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.117149 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.117156 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.117293 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.117319 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.117397 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.117515 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":514,"threads_started":1}
I20260809 06:31:40.118357 1674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ac19f6af1f4465dbdcbbafc3f92677d" candidate_uuid: "0812009ac45044869e464cb3b6d4d245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" is_pre_election: true
I20260809 06:31:40.118714 1889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ac19f6af1f4465dbdcbbafc3f92677d" candidate_uuid: "0812009ac45044869e464cb3b6d4d245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32809d37a9ae4150959b4a094c94fa46" is_pre_election: true
I20260809 06:31:40.118805 1674 raft_consensus.cc:2454] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0812009ac45044869e464cb3b6d4d245 in term 0.
I20260809 06:31:40.118981 1889 raft_consensus.cc:2454] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0812009ac45044869e464cb3b6d4d245 in term 0.
I20260809 06:31:40.119386 1354 leader_election.cc:302] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812009ac45044869e464cb3b6d4d245, 4e0c00453b1a4211aa718ac8b6a9432b; no voters:
I20260809 06:31:40.119737 1998 raft_consensus.cc:2781] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:40.119863 1998 raft_consensus.cc:482] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:40.119968 1998 raft_consensus.cc:3037] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:40.122036 1998 raft_consensus.cc:504] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.122588 1998 leader_election.cc:288] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [CANDIDATE]: Term 1 election: Requested vote from peers 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379), 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571)
I20260809 06:31:40.122988 1674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ac19f6af1f4465dbdcbbafc3f92677d" candidate_uuid: "0812009ac45044869e464cb3b6d4d245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0c00453b1a4211aa718ac8b6a9432b"
I20260809 06:31:40.122972 1889 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ac19f6af1f4465dbdcbbafc3f92677d" candidate_uuid: "0812009ac45044869e464cb3b6d4d245" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32809d37a9ae4150959b4a094c94fa46"
I20260809 06:31:40.123168 1674 raft_consensus.cc:3037] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:40.123191 1889 raft_consensus.cc:3037] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:40.126297 1889 raft_consensus.cc:2454] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0812009ac45044869e464cb3b6d4d245 in term 1.
I20260809 06:31:40.126318 1674 raft_consensus.cc:2454] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0812009ac45044869e464cb3b6d4d245 in term 1.
I20260809 06:31:40.126693 1357 leader_election.cc:302] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812009ac45044869e464cb3b6d4d245, 32809d37a9ae4150959b4a094c94fa46; no voters:
I20260809 06:31:40.127002 1998 raft_consensus.cc:2781] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:40.127408 1998 raft_consensus.cc:686] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [term 1 LEADER]: Becoming Leader. State: Replica: 0812009ac45044869e464cb3b6d4d245, State: Running, Role: LEADER
I20260809 06:31:40.127879 1998 consensus_queue.cc:237] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.131052 2026 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: TxnStatusTablet state changed. Reason: New leader 0812009ac45044869e464cb3b6d4d245. Latest consensus state: current_term: 1 leader_uuid: "0812009ac45044869e464cb3b6d4d245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.131456 2026 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:31:40.132148 2028 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 06:31:40.132416 2028 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 06:31:40.132642 1216 catalog_manager.cc:5495] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0812009ac45044869e464cb3b6d4d245 (127.30.78.65). New cstate: current_term: 1 leader_uuid: "0812009ac45044869e464cb3b6d4d245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } health_report { overall_health: UNKNOWN } } }
I20260809 06:31:40.151101 2016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.145939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32883 (local address 127.0.0.1:51696)
0809 06:31:40.146156 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:40.146171 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:40.146298 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:40.146713 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:40.146717 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:40.146728 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:31:40.146898 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.146907 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.147887 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.147893 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.148866 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.148879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.149550 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.149556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.149784 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.149846 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.150577 (+ 731us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.150607 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.150678 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.150821 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 06:31:40.151125 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.145865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51696 (local address 127.30.78.65:32883)
0809 06:31:40.146015 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.146021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.146237 (+ 216us) server_negotiation.cc:407] Connection header received
0809 06:31:40.146487 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.146490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.146564 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.146676 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:40.147020 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.147765 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.149003 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.149401 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.149506 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.150032 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.150469 (+ 437us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.150599 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.150710 (+ 111us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.150788 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 06:31:40.157778 1889 raft_consensus.cc:1261] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Refusing update from remote peer 0812009ac45044869e464cb3b6d4d245: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:40.158001 1674 raft_consensus.cc:1261] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Refusing update from remote peer 0812009ac45044869e464cb3b6d4d245: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:40.158665 1998 consensus_queue.cc:1035] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:40.158973 2026 consensus_queue.cc:1035] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:40.166930 1997 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: TxnStatusTablet state changed. Reason: New leader 0812009ac45044869e464cb3b6d4d245. Latest consensus state: current_term: 1 leader_uuid: "0812009ac45044869e464cb3b6d4d245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.167268 1997 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:40.171865 1996 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: TxnStatusTablet state changed. Reason: New leader 0812009ac45044869e464cb3b6d4d245. Latest consensus state: current_term: 1 leader_uuid: "0812009ac45044869e464cb3b6d4d245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.172169 1996 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:40.183930 1997 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0812009ac45044869e464cb3b6d4d245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.184171 1997 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 32809d37a9ae4150959b4a094c94fa46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:40.184894 1996 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0812009ac45044869e464cb3b6d4d245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.185160 1996 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 4e0c00453b1a4211aa718ac8b6a9432b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:31:40.190328 1998 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0812009ac45044869e464cb3b6d4d245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.190690 1998 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:31:40.191005 1998 tablet_replica.cc:439] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0812009ac45044869e464cb3b6d4d245" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } } }
I20260809 06:31:40.191301 1998 tablet_replica.cc:442] T 8ac19f6af1f4465dbdcbbafc3f92677d P 0812009ac45044869e464cb3b6d4d245: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:31:40.204761 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.199433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58776 (local address 127.30.78.66:44379)
0809 06:31:40.199600 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.199606 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.199783 (+ 177us) server_negotiation.cc:407] Connection header received
0809 06:31:40.200015 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.200019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.200094 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.200217 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:40.200596 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.201306 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.202737 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.203127 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.203232 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.203686 (+ 454us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.204193 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.204321 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.204414 (+ 93us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.204504 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:31:40.220283 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.214636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:46145 (local address 127.30.78.65:32883)
0809 06:31:40.214800 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.214807 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.215421 (+ 614us) server_negotiation.cc:407] Connection header received
0809 06:31:40.215718 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.215724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.215828 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.215914 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:40.216434 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.217237 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.218632 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.219068 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.219175 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.219588 (+ 413us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.219695 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.219774 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.219915 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.219993 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:31:40.220355 2050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.214634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32883 (local address 127.30.78.66:46145)
0809 06:31:40.215318 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:40.215334 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:40.215520 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:40.215931 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:40.215936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:40.215947 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:31:40.216236 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.216245 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.217362 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.217376 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.218500 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.218513 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.219233 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.219240 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.219353 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.219416 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.219788 (+ 372us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.219799 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.219866 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.219996 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":365,"threads_started":1}
I20260809 06:31:40.229465 1889 raft_consensus.cc:1261] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Refusing update from remote peer 4e0c00453b1a4211aa718ac8b6a9432b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:40.229907 1466 raft_consensus.cc:1261] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Refusing update from remote peer 4e0c00453b1a4211aa718ac8b6a9432b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:40.230594 2001 consensus_queue.cc:1035] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:40.231303 1996 consensus_queue.cc:1035] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:40.241760 2035 mvcc.cc:205] Tried to move back new op lower bound from 7316509082534666240 to 7316509081434173440. Current Snapshot: MvccSnapshot[applied={T|T < 7316509082534666240}]
I20260809 06:31:40.272747 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.265842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:42467 (local address 127.30.78.66:44379)
0809 06:31:40.266024 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.266031 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.266715 (+ 684us) server_negotiation.cc:407] Connection header received
0809 06:31:40.266974 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.266979 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.267060 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.267159 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:40.267806 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.268593 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.270820 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.271394 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.271511 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.272083 (+ 572us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.272210 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.272297 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.272415 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.272492 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 06:31:40.273099 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.265895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:44379 (local address 127.30.78.65:42467)
0809 06:31:40.266612 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:40.266632 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:40.266786 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:40.267192 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:40.267198 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:40.267211 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:31:40.267644 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.267663 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.268721 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.268727 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.270678 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.270694 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.271590 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.271597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.271795 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.271865 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.272298 (+ 433us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.272309 (+ 11us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.272393 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.272531 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":372,"threads_started":1}
I20260809 06:31:40.330969 1216 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:40.331225 1216 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:40.334766 1216 catalog_manager.cc:5782] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca: Sending DeleteTablet for 3 replicas of tablet d1b725b7e41045eb855b7c2dbc49b509
I20260809 06:31:40.335829 1428 tablet_service.cc:1514] Processing DeleteTablet for tablet d1b725b7e41045eb855b7c2dbc49b509 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:40 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:51694
I20260809 06:31:40.336131 1860 tablet_service.cc:1514] Processing DeleteTablet for tablet d1b725b7e41045eb855b7c2dbc49b509 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:40 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:52652
I20260809 06:31:40.337057 1638 tablet_service.cc:1514] Processing DeleteTablet for tablet d1b725b7e41045eb855b7c2dbc49b509 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:40 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:58772
I20260809 06:31:40.338091 1216 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43376:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:31:40.338771 1216 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:31:40.347551 1427 tablet_service.cc:1467] Processing CreateTablet for tablet 3388605482084648babcc52ca475be2d (DEFAULT_TABLE table=test-table [id=ef5791670b484aafb50324cb3d949aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:40.347573 1859 tablet_service.cc:1467] Processing CreateTablet for tablet 3388605482084648babcc52ca475be2d (DEFAULT_TABLE table=test-table [id=ef5791670b484aafb50324cb3d949aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:40.348094 1859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3388605482084648babcc52ca475be2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:40.348182 1427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3388605482084648babcc52ca475be2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:40.350494 1634 tablet_service.cc:1467] Processing CreateTablet for tablet 3388605482084648babcc52ca475be2d (DEFAULT_TABLE table=test-table [id=ef5791670b484aafb50324cb3d949aa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:40.350993 1634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3388605482084648babcc52ca475be2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:40.355024 1992 tablet_bootstrap.cc:492] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: Bootstrap starting.
I20260809 06:31:40.356875 1992 tablet_bootstrap.cc:654] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:40.361879 1990 tablet_bootstrap.cc:492] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: Bootstrap starting.
I20260809 06:31:40.363905 1990 tablet_bootstrap.cc:654] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:40.366930 1990 tablet_bootstrap.cc:492] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: No bootstrap required, opened a new log
I20260809 06:31:40.367107 1990 ts_tablet_manager.cc:1397] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260809 06:31:40.367681 1988 tablet_bootstrap.cc:492] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: Bootstrap starting.
I20260809 06:31:40.367864 1990 raft_consensus.cc:348] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.368152 1990 raft_consensus.cc:374] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:40.368238 1990 raft_consensus.cc:729] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0812009ac45044869e464cb3b6d4d245, State: Initialized, Role: FOLLOWER
I20260809 06:31:40.369380 1988 tablet_bootstrap.cc:654] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:40.369596 1990 consensus_queue.cc:260] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.370381 1990 ts_tablet_manager.cc:1428] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 06:31:40.372835 2064 tablet_replica.cc:330] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: stopping tablet replica
I20260809 06:31:40.376391 2064 raft_consensus.cc:2229] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:40.376724 2064 raft_consensus.cc:2258] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:40.380946 2064 ts_tablet_manager.cc:1905] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:40.384315 1988 tablet_bootstrap.cc:492] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: No bootstrap required, opened a new log
I20260809 06:31:40.384552 1988 ts_tablet_manager.cc:1397] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.007s
I20260809 06:31:40.385639 1988 raft_consensus.cc:348] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.385957 1988 raft_consensus.cc:374] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:40.386171 1988 raft_consensus.cc:729] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0c00453b1a4211aa718ac8b6a9432b, State: Initialized, Role: FOLLOWER
I20260809 06:31:40.386500 1988 consensus_queue.cc:260] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.389315 1988 ts_tablet_manager.cc:1428] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260809 06:31:40.391906 2066 tablet_replica.cc:330] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: stopping tablet replica
I20260809 06:31:40.392390 2066 raft_consensus.cc:2229] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:31:40.393006 2065 tablet_replica.cc:330] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: stopping tablet replica
I20260809 06:31:40.393597 2064 ts_tablet_manager.cc:1918] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:31:40.393810 2064 log.cc:1196] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/d1b725b7e41045eb855b7c2dbc49b509
I20260809 06:31:40.394294 2066 raft_consensus.cc:2258] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:40.394366 2064 ts_tablet_manager.cc:1939] T d1b725b7e41045eb855b7c2dbc49b509 P 0812009ac45044869e464cb3b6d4d245: Deleting consensus metadata
I20260809 06:31:40.394928 2065 raft_consensus.cc:2229] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:40.394977 1992 tablet_bootstrap.cc:492] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: No bootstrap required, opened a new log
I20260809 06:31:40.395254 2065 raft_consensus.cc:2258] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:40.395383 1992 ts_tablet_manager.cc:1397] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: Time spent bootstrapping tablet: real 0.040s user 0.020s sys 0.004s
I20260809 06:31:40.396276 1200 catalog_manager.cc:4841] TS 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883): tablet d1b725b7e41045eb855b7c2dbc49b509 (table test-table [id=3fc501bfa6184b11a165baafb4a9aab9]) successfully deleted
I20260809 06:31:40.396291 1992 raft_consensus.cc:348] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.396693 1992 raft_consensus.cc:374] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:40.396839 1992 raft_consensus.cc:729] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32809d37a9ae4150959b4a094c94fa46, State: Initialized, Role: FOLLOWER
I20260809 06:31:40.397275 2066 ts_tablet_manager.cc:1905] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:40.397207 1992 consensus_queue.cc:260] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.398357 1992 ts_tablet_manager.cc:1428] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260809 06:31:40.402635 2065 ts_tablet_manager.cc:1905] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:40.404592 2066 ts_tablet_manager.cc:1918] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:31:40.404757 2066 log.cc:1196] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/d1b725b7e41045eb855b7c2dbc49b509
I20260809 06:31:40.405283 2066 ts_tablet_manager.cc:1939] T d1b725b7e41045eb855b7c2dbc49b509 P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting consensus metadata
I20260809 06:31:40.406889 1199 catalog_manager.cc:4841] TS 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379): tablet d1b725b7e41045eb855b7c2dbc49b509 (table test-table [id=3fc501bfa6184b11a165baafb4a9aab9]) successfully deleted
I20260809 06:31:40.408619 2065 ts_tablet_manager.cc:1918] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:31:40.408743 2065 log.cc:1196] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/d1b725b7e41045eb855b7c2dbc49b509
I20260809 06:31:40.409152 2065 ts_tablet_manager.cc:1939] T d1b725b7e41045eb855b7c2dbc49b509 P 32809d37a9ae4150959b4a094c94fa46: Deleting consensus metadata
I20260809 06:31:40.410495 1200 catalog_manager.cc:4841] TS 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571): tablet d1b725b7e41045eb855b7c2dbc49b509 (table test-table [id=3fc501bfa6184b11a165baafb4a9aab9]) successfully deleted
I20260809 06:31:40.467731 1997 raft_consensus.cc:482] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:40.468061 1997 raft_consensus.cc:504] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.470120 1997 leader_election.cc:288] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379)
I20260809 06:31:40.489472 1985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.471503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:46349 (local address 127.30.78.66:44379)
0809 06:31:40.471676 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.471681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.481315 (+ 9634us) server_negotiation.cc:407] Connection header received
0809 06:31:40.481648 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.481655 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.481752 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.481817 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:40.482695 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.483824 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.486905 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.488266 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.488423 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.488505 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.489034 (+ 529us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.489174 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:31:40.489811 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.471027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:43683 (local address 127.30.78.65:32883)
0809 06:31:40.471232 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.471238 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.481028 (+ 9790us) server_negotiation.cc:407] Connection header received
0809 06:31:40.481608 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.481620 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.481736 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.481820 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:31:40.482895 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.484097 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.486936 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.488376 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.488547 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.488631 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.489300 (+ 669us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.489448 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:31:40.490746 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.470766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:44379 (local address 127.30.78.67:46349)
0809 06:31:40.481206 (+ 10440us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:40.481225 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:40.481445 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:40.482028 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:40.482033 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:40.482058 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:40.482467 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.482480 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.484012 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.484017 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.486712 (+ 2695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.486727 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.488644 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.488650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.488846 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.488880 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.490076 (+ 1196us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.490271 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10293,"mutex_wait_us":52,"spinlock_wait_cycles":1792,"thread_start_us":10274,"threads_started":1}
I20260809 06:31:40.490823 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.470410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32883 (local address 127.30.78.67:43683)
0809 06:31:40.480886 (+ 10476us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:40.480911 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:40.481374 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:40.482052 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:40.482057 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:40.482086 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:31:40.482673 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.482689 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.484324 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.484330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.486725 (+ 2395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.486742 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.488864 (+ 2122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.488871 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.489070 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.489108 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.490100 (+ 992us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.490314 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10307,"mutex_wait_us":77,"spinlock_wait_cycles":3968,"thread_start_us":10148,"threads_started":1}
I20260809 06:31:40.491729 1674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3388605482084648babcc52ca475be2d" candidate_uuid: "32809d37a9ae4150959b4a094c94fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" is_pre_election: true
I20260809 06:31:40.491993 1674 raft_consensus.cc:2454] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32809d37a9ae4150959b4a094c94fa46 in term 0.
I20260809 06:31:40.492058 1465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3388605482084648babcc52ca475be2d" candidate_uuid: "32809d37a9ae4150959b4a094c94fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245" is_pre_election: true
I20260809 06:31:40.492390 1465 raft_consensus.cc:2454] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32809d37a9ae4150959b4a094c94fa46 in term 0.
I20260809 06:31:40.492585 1773 leader_election.cc:302] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32809d37a9ae4150959b4a094c94fa46, 4e0c00453b1a4211aa718ac8b6a9432b; no voters:
I20260809 06:31:40.493011 1997 raft_consensus.cc:2781] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:40.493127 1997 raft_consensus.cc:482] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:40.493229 1997 raft_consensus.cc:3037] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:40.496390 1997 raft_consensus.cc:504] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.497071 1997 leader_election.cc:288] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [CANDIDATE]: Term 1 election: Requested vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379)
I20260809 06:31:40.497622 1465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3388605482084648babcc52ca475be2d" candidate_uuid: "32809d37a9ae4150959b4a094c94fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245"
I20260809 06:31:40.497678 1674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3388605482084648babcc52ca475be2d" candidate_uuid: "32809d37a9ae4150959b4a094c94fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0c00453b1a4211aa718ac8b6a9432b"
I20260809 06:31:40.497892 1674 raft_consensus.cc:3037] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:40.497888 1465 raft_consensus.cc:3037] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:40.500946 1674 raft_consensus.cc:2454] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32809d37a9ae4150959b4a094c94fa46 in term 1.
I20260809 06:31:40.501291 1465 raft_consensus.cc:2454] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32809d37a9ae4150959b4a094c94fa46 in term 1.
I20260809 06:31:40.501318 1773 leader_election.cc:302] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32809d37a9ae4150959b4a094c94fa46, 4e0c00453b1a4211aa718ac8b6a9432b; no voters:
I20260809 06:31:40.501690 1997 raft_consensus.cc:2781] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:40.502297 1997 raft_consensus.cc:686] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 1 LEADER]: Becoming Leader. State: Replica: 32809d37a9ae4150959b4a094c94fa46, State: Running, Role: LEADER
I20260809 06:31:40.502727 1997 consensus_queue.cc:237] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:40.507453 1216 catalog_manager.cc:5495] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67). New cstate: current_term: 1 leader_uuid: "32809d37a9ae4150959b4a094c94fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } health_report { overall_health: HEALTHY } } }
I20260809 06:31:40.566689 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.559552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52654 (local address 127.30.78.67:39571)
0809 06:31:40.559745 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.559752 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.559774 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:31:40.559875 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.559882 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.559984 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.560181 (+ 197us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:40.560597 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.561700 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.563721 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.564417 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.564569 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.565049 (+ 480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.565947 (+ 898us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.566114 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.566184 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.566292 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:31:40.586086 1984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.579078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:55133 (local address 127.30.78.65:32883)
0809 06:31:40.579302 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.579309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.579484 (+ 175us) server_negotiation.cc:407] Connection header received
0809 06:31:40.579792 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.579799 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.579895 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.580014 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:40.580538 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.581777 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.583870 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.584534 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.584684 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.585225 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.585395 (+ 170us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.585503 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.585642 (+ 139us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.585766 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260809 06:31:40.586391 2078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.578714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32883 (local address 127.30.78.67:55133)
0809 06:31:40.579381 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:40.579401 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:40.579612 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:40.580037 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:40.580042 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:40.580056 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:31:40.580368 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.580380 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.581918 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.581924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.583704 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.583720 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.584739 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.584746 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.584946 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.585016 (+ 70us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.585505 (+ 489us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.585517 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.585601 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.585765 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":610,"threads_started":1}
I20260809 06:31:40.596086 1673 raft_consensus.cc:1261] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Refusing update from remote peer 32809d37a9ae4150959b4a094c94fa46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:40.596338 1465 raft_consensus.cc:1261] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Refusing update from remote peer 32809d37a9ae4150959b4a094c94fa46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:40.596756 1997 consensus_queue.cc:1035] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:40.597244 2072 consensus_queue.cc:1035] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:40.612015 2033 mvcc.cc:205] Tried to move back new op lower bound from 7316509084035309568 to 7316509083664187392. Current Snapshot: MvccSnapshot[applied={T|T < 7316509084035309568}]
I20260809 06:31:40.616822 2032 mvcc.cc:205] Tried to move back new op lower bound from 7316509084035309568 to 7316509083664187392. Current Snapshot: MvccSnapshot[applied={T|T < 7316509084035309568}]
I20260809 06:31:40.656952 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.651271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:39571 (local address 127.30.78.65:34783)
0809 06:31:40.651516 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:40.651537 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:40.651643 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:40.652136 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:40.652141 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:40.652155 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:31:40.652381 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.652394 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.653412 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.653418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.654970 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:40.654987 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.655982 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.655986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:40.656111 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.656148 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.656533 (+ 385us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.656540 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 06:31:40.656589 (+ 49us) client_negotiation.cc:240] Negotiation successful
0809 06:31:40.656689 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260809 06:31:40.656955 1987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:40.651313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:34783 (local address 127.30.78.67:39571)
0809 06:31:40.651859 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:40.651865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:40.651882 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:31:40.651939 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:40.651944 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:40.652020 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:40.652104 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:40.652516 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.653272 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.655152 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:40.655838 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:40.655967 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:40.656307 (+ 340us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:40.656443 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:40.656525 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:40.656611 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 06:31:40.656691 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437}
W20260809 06:31:40.658557 2033 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 06:31:42.279115 1216 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:42.279331 1216 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43376:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:42.283061 1216 catalog_manager.cc:5782] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca: Sending DeleteTablet for 3 replicas of tablet 3388605482084648babcc52ca475be2d
I20260809 06:31:42.283736 1428 tablet_service.cc:1514] Processing DeleteTablet for tablet 3388605482084648babcc52ca475be2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:42 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:51694
I20260809 06:31:42.283895 1638 tablet_service.cc:1514] Processing DeleteTablet for tablet 3388605482084648babcc52ca475be2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:42 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:58772
I20260809 06:31:42.283897 1860 tablet_service.cc:1514] Processing DeleteTablet for tablet 3388605482084648babcc52ca475be2d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:42 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:52652
I20260809 06:31:42.296475 2120 tablet_replica.cc:330] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: stopping tablet replica
I20260809 06:31:42.296608 2116 tablet_replica.cc:330] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: stopping tablet replica
I20260809 06:31:42.296849 2120 raft_consensus.cc:2229] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:42.297173 2120 raft_consensus.cc:2258] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:42.297413 2116 raft_consensus.cc:2229] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:42.298005 2116 raft_consensus.cc:2258] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:42.298306 2120 ts_tablet_manager.cc:1905] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:42.299341 2116 ts_tablet_manager.cc:1905] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:42.305763 2120 ts_tablet_manager.cc:1918] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:31:42.306003 2120 log.cc:1196] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/3388605482084648babcc52ca475be2d
I20260809 06:31:42.306531 2120 ts_tablet_manager.cc:1939] T 3388605482084648babcc52ca475be2d P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting consensus metadata
I20260809 06:31:42.306934 2116 ts_tablet_manager.cc:1918] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:31:42.307745 1199 catalog_manager.cc:4841] TS 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379): tablet 3388605482084648babcc52ca475be2d (table test-table [id=ef5791670b484aafb50324cb3d949aa3]) successfully deleted
I20260809 06:31:42.308737 2116 log.cc:1196] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/3388605482084648babcc52ca475be2d
I20260809 06:31:42.308795 2118 tablet_replica.cc:330] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: stopping tablet replica
I20260809 06:31:42.309018 2118 raft_consensus.cc:2229] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:31:42.309324 2116 ts_tablet_manager.cc:1939] T 3388605482084648babcc52ca475be2d P 0812009ac45044869e464cb3b6d4d245: Deleting consensus metadata
I20260809 06:31:42.309603 2118 raft_consensus.cc:2258] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:42.310565 2118 ts_tablet_manager.cc:1905] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:42.310581 1200 catalog_manager.cc:4841] TS 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883): tablet 3388605482084648babcc52ca475be2d (table test-table [id=ef5791670b484aafb50324cb3d949aa3]) successfully deleted
I20260809 06:31:42.315397 2118 ts_tablet_manager.cc:1918] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:31:42.315529 2118 log.cc:1196] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/3388605482084648babcc52ca475be2d
I20260809 06:31:42.315886 2118 ts_tablet_manager.cc:1939] T 3388605482084648babcc52ca475be2d P 32809d37a9ae4150959b4a094c94fa46: Deleting consensus metadata
I20260809 06:31:42.316821 1200 catalog_manager.cc:4841] TS 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571): tablet 3388605482084648babcc52ca475be2d (table test-table [id=ef5791670b484aafb50324cb3d949aa3]) successfully deleted
Aug 09 06:31:42 dist-test-slave-cvwc krb5kdc[1149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257102, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 06:31:42 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257102, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:42.343585 2133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:42.330549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43400 (local address 127.30.78.126:36361)
0809 06:31:42.331166 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:42.331173 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:42.331282 (+ 109us) server_negotiation.cc:407] Connection header received
0809 06:31:42.331476 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:42.331480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:42.331542 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:42.331649 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:42.332966 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:42.333787 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:42.335022 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:42.335430 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:42.335539 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:42.339225 (+ 3686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:42.339230 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:42.339233 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:42.339264 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:42.341585 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:42.342150 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:42.342153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:42.342156 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:42.342272 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:42.342537 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:42.342540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:42.342542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:42.342785 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:42.342965 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:42.343150 (+ 185us) server_negotiation.cc:299] Negotiation successful
0809 06:31:42.343310 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":265,"threads_started":1}
I20260809 06:31:42.346679 1216 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:31:42.347271 1216 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:31:42.353358 1428 tablet_service.cc:1467] Processing CreateTablet for tablet c066f30e3ce048f6935fa41af5cce788 (DEFAULT_TABLE table=test-table [id=a35f6b1769604b37b260cbeb051b5f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:42.353425 1638 tablet_service.cc:1467] Processing CreateTablet for tablet c066f30e3ce048f6935fa41af5cce788 (DEFAULT_TABLE table=test-table [id=a35f6b1769604b37b260cbeb051b5f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:42.353847 1428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c066f30e3ce048f6935fa41af5cce788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:42.353765 1860 tablet_service.cc:1467] Processing CreateTablet for tablet c066f30e3ce048f6935fa41af5cce788 (DEFAULT_TABLE table=test-table [id=a35f6b1769604b37b260cbeb051b5f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:42.353890 1638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c066f30e3ce048f6935fa41af5cce788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:42.354161 1860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c066f30e3ce048f6935fa41af5cce788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:42.358736 2134 tablet_bootstrap.cc:492] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: Bootstrap starting.
I20260809 06:31:42.360463 2136 tablet_bootstrap.cc:492] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: Bootstrap starting.
I20260809 06:31:42.361147 2137 tablet_bootstrap.cc:492] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: Bootstrap starting.
I20260809 06:31:42.361304 2134 tablet_bootstrap.cc:654] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:42.362303 2136 tablet_bootstrap.cc:654] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:42.362649 2137 tablet_bootstrap.cc:654] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:42.367899 2136 tablet_bootstrap.cc:492] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: No bootstrap required, opened a new log
I20260809 06:31:42.368012 2137 tablet_bootstrap.cc:492] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: No bootstrap required, opened a new log
I20260809 06:31:42.368058 2136 ts_tablet_manager.cc:1397] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260809 06:31:42.368150 2137 ts_tablet_manager.cc:1397] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260809 06:31:42.368558 2134 tablet_bootstrap.cc:492] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: No bootstrap required, opened a new log
I20260809 06:31:42.368700 2134 ts_tablet_manager.cc:1397] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260809 06:31:42.368795 2137 raft_consensus.cc:348] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.369011 2137 raft_consensus.cc:374] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:42.368886 2136 raft_consensus.cc:348] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.369109 2137 raft_consensus.cc:729] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32809d37a9ae4150959b4a094c94fa46, State: Initialized, Role: FOLLOWER
I20260809 06:31:42.369115 2136 raft_consensus.cc:374] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:42.369205 2136 raft_consensus.cc:729] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0812009ac45044869e464cb3b6d4d245, State: Initialized, Role: FOLLOWER
I20260809 06:31:42.369370 2137 consensus_queue.cc:260] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.369475 2136 consensus_queue.cc:260] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.369556 2134 raft_consensus.cc:348] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.369848 2134 raft_consensus.cc:374] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:42.369942 2134 raft_consensus.cc:729] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0c00453b1a4211aa718ac8b6a9432b, State: Initialized, Role: FOLLOWER
I20260809 06:31:42.370062 2137 ts_tablet_manager.cc:1428] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 06:31:42.370091 2136 ts_tablet_manager.cc:1428] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 06:31:42.370196 2134 consensus_queue.cc:260] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.371218 2134 ts_tablet_manager.cc:1428] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 06:31:42.382370 2142 raft_consensus.cc:482] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:42.382514 2142 raft_consensus.cc:504] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.383138 2142 leader_election.cc:288] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571)
I20260809 06:31:42.383525 1466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c066f30e3ce048f6935fa41af5cce788" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245" is_pre_election: true
I20260809 06:31:42.383719 1466 raft_consensus.cc:2454] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 0.
I20260809 06:31:42.383646 1887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c066f30e3ce048f6935fa41af5cce788" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32809d37a9ae4150959b4a094c94fa46" is_pre_election: true
I20260809 06:31:42.383872 1887 raft_consensus.cc:2454] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 0.
I20260809 06:31:42.384120 1570 leader_election.cc:302] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812009ac45044869e464cb3b6d4d245, 4e0c00453b1a4211aa718ac8b6a9432b; no voters:
I20260809 06:31:42.384336 2142 raft_consensus.cc:2781] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:42.384440 2142 raft_consensus.cc:482] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:42.384526 2142 raft_consensus.cc:3037] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:42.386432 2142 raft_consensus.cc:504] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.386868 2142 leader_election.cc:288] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 election: Requested vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571)
I20260809 06:31:42.387276 1466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c066f30e3ce048f6935fa41af5cce788" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245"
I20260809 06:31:42.387446 1466 raft_consensus.cc:3037] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:42.387410 1887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c066f30e3ce048f6935fa41af5cce788" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32809d37a9ae4150959b4a094c94fa46"
I20260809 06:31:42.387581 1887 raft_consensus.cc:3037] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:42.389640 1466 raft_consensus.cc:2454] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 1.
I20260809 06:31:42.389778 1887 raft_consensus.cc:2454] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 1.
I20260809 06:31:42.390033 1570 leader_election.cc:302] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812009ac45044869e464cb3b6d4d245, 4e0c00453b1a4211aa718ac8b6a9432b; no voters:
I20260809 06:31:42.390287 2142 raft_consensus.cc:2781] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:42.390676 2142 raft_consensus.cc:686] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 LEADER]: Becoming Leader. State: Replica: 4e0c00453b1a4211aa718ac8b6a9432b, State: Running, Role: LEADER
I20260809 06:31:42.390919 2142 consensus_queue.cc:237] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.392972 1215 catalog_manager.cc:5495] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66). New cstate: current_term: 1 leader_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } health_report { overall_health: UNKNOWN } } }
I20260809 06:31:42.412106 2149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:42.407764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58790 (local address 127.30.78.66:44379)
0809 06:31:42.408273 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:42.408278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:42.408295 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:31:42.408342 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:42.408345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:42.408408 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:42.408484 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:42.408778 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:42.409504 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:42.410673 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:42.411069 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:42.411152 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:42.411486 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:42.411580 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:42.411642 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:42.411728 (+ 86us) server_negotiation.cc:299] Negotiation successful
0809 06:31:42.411781 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":291,"threads_started":1}
I20260809 06:31:42.419567 1887 raft_consensus.cc:1261] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Refusing update from remote peer 4e0c00453b1a4211aa718ac8b6a9432b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:42.419669 1466 raft_consensus.cc:1261] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Refusing update from remote peer 4e0c00453b1a4211aa718ac8b6a9432b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:42.420070 2143 consensus_queue.cc:1035] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [LEADER]: Connected to new peer: Peer: permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:42.420383 2142 consensus_queue.cc:1035] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:42.461061 1216 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:42.461272 1216 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:42.463960 1216 catalog_manager.cc:5782] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca: Sending DeleteTablet for 3 replicas of tablet c066f30e3ce048f6935fa41af5cce788
I20260809 06:31:42.464591 1428 tablet_service.cc:1514] Processing DeleteTablet for tablet c066f30e3ce048f6935fa41af5cce788 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:42 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:51694
I20260809 06:31:42.464851 2116 tablet_replica.cc:330] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: stopping tablet replica
I20260809 06:31:42.464830 1860 tablet_service.cc:1514] Processing DeleteTablet for tablet c066f30e3ce048f6935fa41af5cce788 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:42 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:52652
I20260809 06:31:42.464830 1638 tablet_service.cc:1514] Processing DeleteTablet for tablet c066f30e3ce048f6935fa41af5cce788 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:42 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:58772
I20260809 06:31:42.465056 2116 raft_consensus.cc:2229] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:42.465221 2116 raft_consensus.cc:2258] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:42.465402 2118 tablet_replica.cc:330] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: stopping tablet replica
I20260809 06:31:42.465586 2118 raft_consensus.cc:2229] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:42.465785 2118 raft_consensus.cc:2258] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:42.466042 2120 tablet_replica.cc:330] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: stopping tablet replica
I20260809 06:31:42.465888 1216 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43400:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 06:31:42.466221 2120 raft_consensus.cc:2229] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:31:42.466339 2116 ts_tablet_manager.cc:1905] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260809 06:31:42.466400 1216 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:31:42.466542 2120 raft_consensus.cc:2258] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:42.467715 2118 ts_tablet_manager.cc:1905] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:42.468101 2120 ts_tablet_manager.cc:1905] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:42.471530 2116 ts_tablet_manager.cc:1918] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:31:42.471661 2116 log.cc:1196] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/c066f30e3ce048f6935fa41af5cce788
I20260809 06:31:42.472003 2116 ts_tablet_manager.cc:1939] T c066f30e3ce048f6935fa41af5cce788 P 0812009ac45044869e464cb3b6d4d245: Deleting consensus metadata
I20260809 06:31:42.472826 1200 catalog_manager.cc:4841] TS 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883): tablet c066f30e3ce048f6935fa41af5cce788 (table test-table [id=a35f6b1769604b37b260cbeb051b5f2b]) successfully deleted
I20260809 06:31:42.474227 2120 ts_tablet_manager.cc:1918] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:31:42.474383 2120 log.cc:1196] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/c066f30e3ce048f6935fa41af5cce788
I20260809 06:31:42.474817 2120 ts_tablet_manager.cc:1939] T c066f30e3ce048f6935fa41af5cce788 P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting consensus metadata
I20260809 06:31:42.475203 2118 ts_tablet_manager.cc:1918] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:31:42.475353 2118 log.cc:1196] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/c066f30e3ce048f6935fa41af5cce788
I20260809 06:31:42.475781 2118 ts_tablet_manager.cc:1939] T c066f30e3ce048f6935fa41af5cce788 P 32809d37a9ae4150959b4a094c94fa46: Deleting consensus metadata
I20260809 06:31:42.475787 1199 catalog_manager.cc:4841] TS 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379): tablet c066f30e3ce048f6935fa41af5cce788 (table test-table [id=a35f6b1769604b37b260cbeb051b5f2b]) successfully deleted
I20260809 06:31:42.476903 1200 catalog_manager.cc:4841] TS 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571): tablet c066f30e3ce048f6935fa41af5cce788 (table test-table [id=a35f6b1769604b37b260cbeb051b5f2b]) successfully deleted
I20260809 06:31:42.478348 1638 tablet_service.cc:1467] Processing CreateTablet for tablet 08b4eef0c1614cb2b7dfc93ad80afc59 (DEFAULT_TABLE table=test-table [id=ed5b26beab884e08a43d04a05bdd605e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:42.478744 1638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08b4eef0c1614cb2b7dfc93ad80afc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:42.478729 1860 tablet_service.cc:1467] Processing CreateTablet for tablet 08b4eef0c1614cb2b7dfc93ad80afc59 (DEFAULT_TABLE table=test-table [id=ed5b26beab884e08a43d04a05bdd605e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:42.479099 1860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08b4eef0c1614cb2b7dfc93ad80afc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:42.479044 1428 tablet_service.cc:1467] Processing CreateTablet for tablet 08b4eef0c1614cb2b7dfc93ad80afc59 (DEFAULT_TABLE table=test-table [id=ed5b26beab884e08a43d04a05bdd605e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:31:42.479421 1428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08b4eef0c1614cb2b7dfc93ad80afc59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:42.483433 2137 tablet_bootstrap.cc:492] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: Bootstrap starting.
I20260809 06:31:42.484977 2134 tablet_bootstrap.cc:492] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: Bootstrap starting.
I20260809 06:31:42.484983 2137 tablet_bootstrap.cc:654] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:42.485541 2136 tablet_bootstrap.cc:492] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: Bootstrap starting.
I20260809 06:31:42.486691 2134 tablet_bootstrap.cc:654] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:42.487187 2136 tablet_bootstrap.cc:654] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:42.488744 2134 tablet_bootstrap.cc:492] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: No bootstrap required, opened a new log
I20260809 06:31:42.488919 2134 ts_tablet_manager.cc:1397] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260809 06:31:42.489265 2137 tablet_bootstrap.cc:492] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: No bootstrap required, opened a new log
I20260809 06:31:42.489434 2137 ts_tablet_manager.cc:1397] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260809 06:31:42.489658 2136 tablet_bootstrap.cc:492] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: No bootstrap required, opened a new log
I20260809 06:31:42.489622 2134 raft_consensus.cc:348] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.489833 2136 ts_tablet_manager.cc:1397] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 06:31:42.489909 2134 raft_consensus.cc:374] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:42.489987 2134 raft_consensus.cc:729] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0c00453b1a4211aa718ac8b6a9432b, State: Initialized, Role: FOLLOWER
I20260809 06:31:42.490151 2137 raft_consensus.cc:348] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.490216 2134 consensus_queue.cc:260] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.490401 2137 raft_consensus.cc:374] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:42.490486 2137 raft_consensus.cc:729] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32809d37a9ae4150959b4a094c94fa46, State: Initialized, Role: FOLLOWER
I20260809 06:31:42.490510 2136 raft_consensus.cc:348] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.490733 2134 ts_tablet_manager.cc:1428] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 06:31:42.490757 2136 raft_consensus.cc:374] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:42.490844 2136 raft_consensus.cc:729] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0812009ac45044869e464cb3b6d4d245, State: Initialized, Role: FOLLOWER
I20260809 06:31:42.490726 2137 consensus_queue.cc:260] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.491072 2136 consensus_queue.cc:260] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.491572 2136 ts_tablet_manager.cc:1428] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260809 06:31:42.491946 2137 ts_tablet_manager.cc:1428] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260809 06:31:42.961593 2155 raft_consensus.cc:482] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:42.961863 2155 raft_consensus.cc:504] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.962368 2105 raft_consensus.cc:482] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:31:42.962577 2105 raft_consensus.cc:504] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.962738 2155 leader_election.cc:288] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571)
I20260809 06:31:42.963256 1466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b4eef0c1614cb2b7dfc93ad80afc59" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245" is_pre_election: true
I20260809 06:31:42.963379 2105 leader_election.cc:288] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379)
I20260809 06:31:42.963346 1887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b4eef0c1614cb2b7dfc93ad80afc59" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32809d37a9ae4150959b4a094c94fa46" is_pre_election: true
I20260809 06:31:42.963544 1466 raft_consensus.cc:2454] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 0.
I20260809 06:31:42.963577 1887 raft_consensus.cc:2454] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4e0c00453b1a4211aa718ac8b6a9432b in term 0.
I20260809 06:31:42.963894 1465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b4eef0c1614cb2b7dfc93ad80afc59" candidate_uuid: "32809d37a9ae4150959b4a094c94fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245" is_pre_election: true
I20260809 06:31:42.964021 1570 leader_election.cc:302] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812009ac45044869e464cb3b6d4d245, 4e0c00453b1a4211aa718ac8b6a9432b; no voters:
I20260809 06:31:42.964112 1465 raft_consensus.cc:2454] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32809d37a9ae4150959b4a094c94fa46 in term 0.
I20260809 06:31:42.964332 2155 raft_consensus.cc:2781] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:42.964469 2155 raft_consensus.cc:482] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:42.964587 2155 raft_consensus.cc:3037] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:42.964502 1673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b4eef0c1614cb2b7dfc93ad80afc59" candidate_uuid: "32809d37a9ae4150959b4a094c94fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" is_pre_election: true
I20260809 06:31:42.964627 1774 leader_election.cc:302] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0812009ac45044869e464cb3b6d4d245, 32809d37a9ae4150959b4a094c94fa46; no voters:
I20260809 06:31:42.964856 2105 raft_consensus.cc:2781] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:31:42.964963 2105 raft_consensus.cc:482] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:31:42.965051 2105 raft_consensus.cc:3037] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:42.966949 2155 raft_consensus.cc:504] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.967201 2105 raft_consensus.cc:504] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.967375 1673 raft_consensus.cc:2379] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32809d37a9ae4150959b4a094c94fa46 in current term 1: Already voted for candidate 4e0c00453b1a4211aa718ac8b6a9432b in this term.
I20260809 06:31:42.967528 2155 leader_election.cc:288] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 election: Requested vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571)
I20260809 06:31:42.968032 2105 leader_election.cc:288] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [CANDIDATE]: Term 1 election: Requested vote from peers 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883), 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379)
I20260809 06:31:42.968096 1887 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b4eef0c1614cb2b7dfc93ad80afc59" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32809d37a9ae4150959b4a094c94fa46"
I20260809 06:31:42.968384 1887 raft_consensus.cc:2379] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e0c00453b1a4211aa718ac8b6a9432b in current term 1: Already voted for candidate 32809d37a9ae4150959b4a094c94fa46 in this term.
I20260809 06:31:42.968490 1673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b4eef0c1614cb2b7dfc93ad80afc59" candidate_uuid: "32809d37a9ae4150959b4a094c94fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4e0c00453b1a4211aa718ac8b6a9432b"
I20260809 06:31:42.968730 1673 raft_consensus.cc:2379] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32809d37a9ae4150959b4a094c94fa46 in current term 1: Already voted for candidate 4e0c00453b1a4211aa718ac8b6a9432b in this term.
I20260809 06:31:42.968767 1465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b4eef0c1614cb2b7dfc93ad80afc59" candidate_uuid: "32809d37a9ae4150959b4a094c94fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245"
I20260809 06:31:42.968967 1465 raft_consensus.cc:3037] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:42.971127 1465 raft_consensus.cc:2454] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32809d37a9ae4150959b4a094c94fa46 in term 1.
I20260809 06:31:42.971483 1774 leader_election.cc:302] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0812009ac45044869e464cb3b6d4d245, 32809d37a9ae4150959b4a094c94fa46; no voters: 4e0c00453b1a4211aa718ac8b6a9432b
I20260809 06:31:42.971637 1465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "08b4eef0c1614cb2b7dfc93ad80afc59" candidate_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0812009ac45044869e464cb3b6d4d245"
I20260809 06:31:42.971837 2105 raft_consensus.cc:2781] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:42.971901 1465 raft_consensus.cc:2379] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4e0c00453b1a4211aa718ac8b6a9432b in current term 1: Already voted for candidate 32809d37a9ae4150959b4a094c94fa46 in this term.
I20260809 06:31:42.972249 2105 raft_consensus.cc:686] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 1 LEADER]: Becoming Leader. State: Replica: 32809d37a9ae4150959b4a094c94fa46, State: Running, Role: LEADER
I20260809 06:31:42.972285 1570 leader_election.cc:302] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4e0c00453b1a4211aa718ac8b6a9432b; no voters: 0812009ac45044869e464cb3b6d4d245, 32809d37a9ae4150959b4a094c94fa46
I20260809 06:31:42.972543 2155 raft_consensus.cc:2726] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260809 06:31:42.972550 2105 consensus_queue.cc:237] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } }
I20260809 06:31:42.975193 1215 catalog_manager.cc:5495] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67). New cstate: current_term: 1 leader_uuid: "32809d37a9ae4150959b4a094c94fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32809d37a9ae4150959b4a094c94fa46" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39571 } health_report { overall_health: HEALTHY } } }
I20260809 06:31:43.060438 2179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:43.055616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48946 (local address 127.30.78.67:39571)
0809 06:31:43.056101 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:43.056105 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:43.056191 (+ 86us) server_negotiation.cc:407] Connection header received
0809 06:31:43.056328 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:43.056332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:43.056399 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:43.056477 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:31:43.056899 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:43.057609 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:43.058965 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:43.059361 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:43.059488 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:43.059811 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:31:43.059911 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:31:43.059976 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:43.060058 (+ 82us) server_negotiation.cc:299] Negotiation successful
0809 06:31:43.060126 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":226,"threads_started":1}
I20260809 06:31:43.068253 1673 raft_consensus.cc:1261] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Refusing update from remote peer 32809d37a9ae4150959b4a094c94fa46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:43.068305 1465 raft_consensus.cc:1261] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Refusing update from remote peer 32809d37a9ae4150959b4a094c94fa46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:31:43.068854 2105 consensus_queue.cc:1035] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0812009ac45044869e464cb3b6d4d245" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:31:43.069144 2159 consensus_queue.cc:1035] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4e0c00453b1a4211aa718ac8b6a9432b" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 06:31:43.088874 2169 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260809 06:31:44.660313 1213 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:44.660542 1213 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43400:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:31:44.664341 1213 catalog_manager.cc:5782] T 00000000000000000000000000000000 P de0f7d073dcc4c5381e4d2c7dba4ffca: Sending DeleteTablet for 3 replicas of tablet 08b4eef0c1614cb2b7dfc93ad80afc59
I20260809 06:31:44.665099 1860 tablet_service.cc:1514] Processing DeleteTablet for tablet 08b4eef0c1614cb2b7dfc93ad80afc59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:44 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:52652
I20260809 06:31:44.665107 1428 tablet_service.cc:1514] Processing DeleteTablet for tablet 08b4eef0c1614cb2b7dfc93ad80afc59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:44 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:51694
I20260809 06:31:44.665223 1638 tablet_service.cc:1514] Processing DeleteTablet for tablet 08b4eef0c1614cb2b7dfc93ad80afc59 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:31:44 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:58772
I20260809 06:31:44.665761 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1330
I20260809 06:31:44.689119 2232 tablet_replica.cc:330] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: stopping tablet replica
I20260809 06:31:44.689330 2230 tablet_replica.cc:330] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: stopping tablet replica
I20260809 06:31:44.689424 2232 raft_consensus.cc:2229] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:44.689652 2230 raft_consensus.cc:2229] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:31:44.689707 2232 raft_consensus.cc:2258] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:44.690124 2230 raft_consensus.cc:2258] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:44.690613 2229 tablet_replica.cc:330] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: stopping tablet replica
I20260809 06:31:44.690795 2229 raft_consensus.cc:2229] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:31:44.691001 2229 raft_consensus.cc:2258] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:31:44.691159 2230 ts_tablet_manager.cc:1905] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:44.691454 2232 ts_tablet_manager.cc:1905] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:31:44.691776 2229 ts_tablet_manager.cc:1905] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 06:31:44 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257102, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:31:44.697748 2230 ts_tablet_manager.cc:1918] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:31:44.697772 2232 ts_tablet_manager.cc:1918] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:31:44.697896 2232 log.cc:1196] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/08b4eef0c1614cb2b7dfc93ad80afc59
I20260809 06:31:44.698002 2230 log.cc:1196] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/08b4eef0c1614cb2b7dfc93ad80afc59
I20260809 06:31:44.698432 2230 ts_tablet_manager.cc:1939] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 32809d37a9ae4150959b4a094c94fa46: Deleting consensus metadata
I20260809 06:31:44.698446 2232 ts_tablet_manager.cc:1939] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 4e0c00453b1a4211aa718ac8b6a9432b: Deleting consensus metadata
I20260809 06:31:44.699523 1200 catalog_manager.cc:4841] TS 32809d37a9ae4150959b4a094c94fa46 (127.30.78.67:39571): tablet 08b4eef0c1614cb2b7dfc93ad80afc59 (table test-table [id=ed5b26beab884e08a43d04a05bdd605e]) successfully deleted
I20260809 06:31:44.699640 1199 catalog_manager.cc:4841] TS 4e0c00453b1a4211aa718ac8b6a9432b (127.30.78.66:44379): tablet 08b4eef0c1614cb2b7dfc93ad80afc59 (table test-table [id=ed5b26beab884e08a43d04a05bdd605e]) successfully deleted
I20260809 06:31:44.700124 2229 ts_tablet_manager.cc:1918] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260809 06:31:44.700263 2229 log.cc:1196] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/08b4eef0c1614cb2b7dfc93ad80afc59
I20260809 06:31:44.700736 2229 ts_tablet_manager.cc:1939] T 08b4eef0c1614cb2b7dfc93ad80afc59 P 0812009ac45044869e464cb3b6d4d245: Deleting consensus metadata
I20260809 06:31:44.701663 1200 catalog_manager.cc:4841] TS 0812009ac45044869e464cb3b6d4d245 (127.30.78.65:32883): tablet 08b4eef0c1614cb2b7dfc93ad80afc59 (table test-table [id=ed5b26beab884e08a43d04a05bdd605e]) successfully deleted
I20260809 06:31:44.703518 2233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:44.667105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59666 (local address 127.30.78.65:32883)
0809 06:31:44.682221 (+ 15116us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:44.682227 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:44.682253 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:31:44.682320 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:44.682326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:44.682417 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:44.682533 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:44.684463 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:44.685768 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:44.687701 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:44.688393 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:44.688510 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:44.696575 (+ 8065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:44.696598 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:44.696620 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:44.696658 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:44.700917 (+ 4259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:44.701533 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:44.701540 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:44.701542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:44.701680 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:44.702070 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:44.702075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:44.702078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:44.702407 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:44.702693 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:44.702963 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 06:31:44.703167 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14966,"thread_start_us":14807,"threads_started":1}
W20260809 06:31:44.704110 1527 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59666
W20260809 06:31:44.704651 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1330: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:31:44.704833 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1330
I20260809 06:31:44.732622 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1542
Aug 09 06:31:44 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257102, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:31:44.746951 2237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:44.733255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37604 (local address 127.30.78.66:44379)
0809 06:31:44.733799 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:44.733803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:44.733818 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:31:44.733871 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:44.733875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:44.733933 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:44.734033 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:44.735251 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:44.736022 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:44.737193 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:44.737595 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:44.737703 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:44.741649 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:44.741662 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:44.741677 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:44.741738 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:44.744420 (+ 2682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:44.745020 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:44.745027 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:44.745029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:44.745159 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:44.745505 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:44.745509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:44.745511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:44.745873 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:44.746144 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:44.746413 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 06:31:44.746629 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":272,"threads_started":1}
W20260809 06:31:44.747583 1739 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37604
W20260809 06:31:44.748159 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1542: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:31:44.748287 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1542
I20260809 06:31:44.777801 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1750
Aug 09 06:31:44 dist-test-slave-cvwc krb5kdc[1149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257102, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:31:44.794436 2239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:44.778496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48956 (local address 127.30.78.67:39571)
0809 06:31:44.779029 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:44.779034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:44.779050 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:31:44.779106 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:44.779110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:44.779178 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:44.779282 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:44.780950 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:44.781850 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:44.783556 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:44.783984 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:44.784070 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:44.788844 (+ 4774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:44.788859 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:44.788882 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:44.788913 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:44.791691 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:44.792336 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:44.792344 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:44.792346 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:44.792487 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:44.792839 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:44.792844 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:44.792847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:44.793349 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:44.793629 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:44.793942 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 06:31:44.794124 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":251,"threads_started":1}
W20260809 06:31:44.795076 1956 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48956
W20260809 06:31:44.795635 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1750: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:31:44.795783 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1750
I20260809 06:31:44.824414 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1165
I20260809 06:31:44.825547 1275 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:44.946399 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1165
2026-08-09T06:31:44Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8498 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:31:45 dist-test-slave-cvwc krb5kdc[2243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:31:45 dist-test-slave-cvwc krb5kdc[2243](info): set up 2 sockets
Aug 09 06:31:45 dist-test-slave-cvwc krb5kdc[2243](info): commencing operation
krb5kdc: starting...
W20260809 06:31:46.122813 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:31:46 dist-test-slave-cvwc krb5kdc[2243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:31:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:31:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:31:46.297015 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:40243
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:37669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:40243
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:46.605749 2261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:46.606061 2261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:46.606215 2261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:46.613477 2261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:31:46.613590 2261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:46.613677 2261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:46.613806 2261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:31:46.613871 2261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:31:46.623682 2261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:37669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:40243
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:40243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:46.624996 2261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:46.626327 2261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:46.638077 2270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:46.638172 2272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:46.638226 2261 server_base.cc:1034] running on GCE node
W20260809 06:31:46.638502 2269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:46.639298 2261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:46.640522 2261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:46.641741 2261 hybrid_clock.cc:648] HybridClock initialized: now 1786257106641668 us; error 40 us; skew 500 ppm
I20260809 06:31:46.642061 2261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:46 dist-test-slave-cvwc krb5kdc[2243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257106, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:46.644845 2261 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:31:46.646207 2261 webserver.cc:460] Webserver started at http://127.30.78.126:45777/ using document root <none> and password file <none>
I20260809 06:31:46.646821 2261 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:46.646941 2261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:46.647222 2261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:46.650041 2261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "175811e4e5de46b9a1380cc50f8c198b"
format_stamp: "Formatted at 2026-08-09 06:31:46 on dist-test-slave-cvwc"
server_key: "39bd41bde8a2479e2dc7924ec4aff435"
server_key_iv: "819e4845178a90e0052302505494aeea"
server_key_version: "encryptionkey@0"
I20260809 06:31:46.650754 2261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "175811e4e5de46b9a1380cc50f8c198b"
format_stamp: "Formatted at 2026-08-09 06:31:46 on dist-test-slave-cvwc"
server_key: "39bd41bde8a2479e2dc7924ec4aff435"
server_key_iv: "819e4845178a90e0052302505494aeea"
server_key_version: "encryptionkey@0"
I20260809 06:31:46.655517 2261 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:31:46.658653 2282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:46.659813 2261 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:31:46.659970 2261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "175811e4e5de46b9a1380cc50f8c198b"
format_stamp: "Formatted at 2026-08-09 06:31:46 on dist-test-slave-cvwc"
server_key: "39bd41bde8a2479e2dc7924ec4aff435"
server_key_iv: "819e4845178a90e0052302505494aeea"
server_key_version: "encryptionkey@0"
I20260809 06:31:46.660130 2261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:46.672410 2261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:46.676678 2261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:46.676971 2261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:46.694993 2261 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:40243
I20260809 06:31:46.695009 2364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:40243 every 8 connection(s)
I20260809 06:31:46.696492 2261 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:31:46.700095 2367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:46.700466 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 2261
I20260809 06:31:46.700721 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:31:46.701525 31033 external_mini_cluster.cc:1428] Setting key 13976b97c2886db407edb864ee85de1f
I20260809 06:31:46.713660 2367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b: Bootstrap starting.
Aug 09 06:31:46 dist-test-slave-cvwc krb5kdc[2243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:46.717197 2367 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:46.718536 2367 log.cc:824] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:46.721576 2367 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b: No bootstrap required, opened a new log
I20260809 06:31:46.724583 2373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:46.703525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59788 (local address 127.30.78.126:40243)
0809 06:31:46.704229 (+ 704us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:46.704240 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:46.704280 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:31:46.706276 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:46.706300 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:46.706689 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:46.707017 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:46.708646 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:46.709939 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:46.711699 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:46.712332 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:46.712463 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:46.716830 (+ 4367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:46.716841 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:46.716859 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:46.716901 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:46.720386 (+ 3485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:46.721032 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:46.721041 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:46.721049 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:46.721250 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:46.721566 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:46.721572 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:46.721575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:46.722297 (+ 722us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:46.722611 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:46.722875 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 06:31:46.723274 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":316,"threads_started":1}
I20260809 06:31:46.730229 2367 raft_consensus.cc:348] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175811e4e5de46b9a1380cc50f8c198b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40243 } }
I20260809 06:31:46.730535 2367 raft_consensus.cc:374] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:46.730608 2367 raft_consensus.cc:729] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 175811e4e5de46b9a1380cc50f8c198b, State: Initialized, Role: FOLLOWER
I20260809 06:31:46.731174 2367 consensus_queue.cc:260] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175811e4e5de46b9a1380cc50f8c198b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40243 } }
I20260809 06:31:46.731412 2367 raft_consensus.cc:388] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:31:46.731544 2367 raft_consensus.cc:482] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:31:46.731698 2367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:46.733805 2367 raft_consensus.cc:504] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175811e4e5de46b9a1380cc50f8c198b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40243 } }
I20260809 06:31:46.734279 2367 leader_election.cc:302] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 175811e4e5de46b9a1380cc50f8c198b; no voters:
I20260809 06:31:46.734911 2367 leader_election.cc:288] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:31:46.735014 2377 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:46.735697 2377 raft_consensus.cc:686] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [term 1 LEADER]: Becoming Leader. State: Replica: 175811e4e5de46b9a1380cc50f8c198b, State: Running, Role: LEADER
I20260809 06:31:46.736255 2377 consensus_queue.cc:237] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175811e4e5de46b9a1380cc50f8c198b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40243 } }
I20260809 06:31:46.736938 2367 sys_catalog.cc:564] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:31:46.739030 2378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "175811e4e5de46b9a1380cc50f8c198b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175811e4e5de46b9a1380cc50f8c198b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40243 } } }
I20260809 06:31:46.739475 2378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:46.739717 2379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 175811e4e5de46b9a1380cc50f8c198b. Latest consensus state: current_term: 1 leader_uuid: "175811e4e5de46b9a1380cc50f8c198b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "175811e4e5de46b9a1380cc50f8c198b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40243 } } }
I20260809 06:31:46.740037 2379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:46.742590 2386 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:31:46.746934 2386 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:31:46.754251 2386 catalog_manager.cc:1347] Generated new cluster ID: b47863125f7c40b4aed753c7553a45b0
I20260809 06:31:46.754354 2386 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:31:46.773867 2386 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:31:46.775094 2386 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:31:46.782748 2386 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 175811e4e5de46b9a1380cc50f8c198b: Generated new TSK 0
I20260809 06:31:46.783707 2386 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:31:46.836952 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40243
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:37669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:47.162122 2409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:47.162395 2409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:47.162530 2409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:47.169862 2409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:47.169972 2409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:47.170131 2409 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:31:47.180099 2409 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:37669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:47.181303 2409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:47.182597 2409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:47.195585 2415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:47.195578 2419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:47.195730 2414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:47.196424 2409 server_base.cc:1034] running on GCE node
I20260809 06:31:47.196957 2409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:47.197844 2409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:47.199044 2409 hybrid_clock.cc:648] HybridClock initialized: now 1786257107198987 us; error 47 us; skew 500 ppm
I20260809 06:31:47.199321 2409 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:47 dist-test-slave-cvwc krb5kdc[2243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257107, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:47.202219 2409 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:31:47.203646 2409 webserver.cc:460] Webserver started at http://127.30.78.65:40959/ using document root <none> and password file <none>
I20260809 06:31:47.204274 2409 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:47.204394 2409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:47.204679 2409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:47.207466 2409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "61ce5a6e53d942fbb929afa4c226c977"
format_stamp: "Formatted at 2026-08-09 06:31:47 on dist-test-slave-cvwc"
server_key: "aa975a83d439a21811b2a90fafc4e96d"
server_key_iv: "1118071623adc092cee6b5fa120dd757"
server_key_version: "encryptionkey@0"
I20260809 06:31:47.208218 2409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "61ce5a6e53d942fbb929afa4c226c977"
format_stamp: "Formatted at 2026-08-09 06:31:47 on dist-test-slave-cvwc"
server_key: "aa975a83d439a21811b2a90fafc4e96d"
server_key_iv: "1118071623adc092cee6b5fa120dd757"
server_key_version: "encryptionkey@0"
I20260809 06:31:47.212954 2409 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:31:47.216092 2431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:47.217265 2409 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:31:47.217420 2409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "61ce5a6e53d942fbb929afa4c226c977"
format_stamp: "Formatted at 2026-08-09 06:31:47 on dist-test-slave-cvwc"
server_key: "aa975a83d439a21811b2a90fafc4e96d"
server_key_iv: "1118071623adc092cee6b5fa120dd757"
server_key_version: "encryptionkey@0"
I20260809 06:31:47.217598 2409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:47.236605 2409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:47.240357 2409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:47.240629 2409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:47.241544 2409 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:47.242929 2409 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:47.243008 2409 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:47.243134 2409 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:47.243186 2409 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:47.272557 2409 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:39495
I20260809 06:31:47.272595 2577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:39495 every 8 connection(s)
I20260809 06:31:47.273802 2409 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:31:47.275238 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 2409
I20260809 06:31:47.275441 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:31:47.276206 31033 external_mini_cluster.cc:1428] Setting key 80bd70a9fe1388323b98832585eec347
Aug 09 06:31:47 dist-test-slave-cvwc krb5kdc[2243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257107, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
I20260809 06:31:47.293531 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:47.276329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:56125 (local address 127.30.78.126:40243)
0809 06:31:47.277456 (+ 1127us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:47.277463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:47.278179 (+ 716us) server_negotiation.cc:407] Connection header received
0809 06:31:47.280047 (+ 1868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:47.280053 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:47.280130 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:47.280237 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:47.281652 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:47.282572 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:47.284374 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:47.284762 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:47.284900 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:47.288215 (+ 3315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:47.288220 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:47.288224 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:47.288256 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:47.290701 (+ 2445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:47.291349 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:47.291356 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:47.291360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:47.291478 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:47.291864 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:47.291878 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:47.291881 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:47.292131 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:47.292258 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:47.292947 (+ 689us) server_negotiation.cc:299] Negotiation successful
0809 06:31:47.293170 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":971,"thread_start_us":840,"threads_started":1}
I20260809 06:31:47.294535 2584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:47.276988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:40243 (local address 127.30.78.65:56125)
0809 06:31:47.278019 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:47.278071 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:47.279781 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:47.280410 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:47.280417 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:47.280922 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:47.281469 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:47.281487 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:47.282721 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:47.282725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:47.284230 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:47.284245 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:47.285145 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:47.285151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:47.285341 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:47.285982 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:47.286009 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:47.288008 (+ 1999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:47.290827 (+ 2819us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:47.290836 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:47.290851 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:47.291239 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:47.291577 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:47.291582 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:47.291586 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:47.291761 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:47.292251 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:47.292259 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:47.292583 (+ 324us) client_negotiation.cc:769] Sending connection context
0809 06:31:47.292828 (+ 245us) client_negotiation.cc:240] Negotiation successful
0809 06:31:47.293321 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":510,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
I20260809 06:31:47.296188 2578 heartbeater.cc:347] Connected to a master server at 127.30.78.126:40243
I20260809 06:31:47.296478 2578 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:47.297156 2578 heartbeater.cc:511] Master 127.30.78.126:40243 requested a full tablet report, sending...
I20260809 06:31:47.299149 2309 ts_manager.cc:194] Registered new tserver with Master: 61ce5a6e53d942fbb929afa4c226c977 (127.30.78.65:39495)
I20260809 06:31:47.300813 2309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:56125
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:31:47.316093 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40243
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:37669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:47.627314 2588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:47.627569 2588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:47.627668 2588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:47.634696 2588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:47.634800 2588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:47.634914 2588 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:31:47.644199 2588 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:37669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:47.645323 2588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:47.646549 2588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:47.658414 2602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:47.658483 2595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:47.658509 2598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:47.659565 2588 server_base.cc:1034] running on GCE node
I20260809 06:31:47.660147 2588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:47.660967 2588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:47.662154 2588 hybrid_clock.cc:648] HybridClock initialized: now 1786257107662113 us; error 30 us; skew 500 ppm
I20260809 06:31:47.662433 2588 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:47 dist-test-slave-cvwc krb5kdc[2243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257107, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:47.665304 2588 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:31:47.666602 2588 webserver.cc:460] Webserver started at http://127.30.78.66:36787/ using document root <none> and password file <none>
I20260809 06:31:47.667218 2588 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:47.667330 2588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:47.667613 2588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:47.670341 2588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "72d201f8d28b442486a9da5e630e9986"
format_stamp: "Formatted at 2026-08-09 06:31:47 on dist-test-slave-cvwc"
server_key: "61e35221fdfe36375a4921448021cb2b"
server_key_iv: "ecd66ca33c57b06ba34f75b32824ab1d"
server_key_version: "encryptionkey@0"
I20260809 06:31:47.671069 2588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "72d201f8d28b442486a9da5e630e9986"
format_stamp: "Formatted at 2026-08-09 06:31:47 on dist-test-slave-cvwc"
server_key: "61e35221fdfe36375a4921448021cb2b"
server_key_iv: "ecd66ca33c57b06ba34f75b32824ab1d"
server_key_version: "encryptionkey@0"
I20260809 06:31:47.675803 2588 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:31:47.679092 2612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:47.680325 2588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:31:47.680482 2588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "72d201f8d28b442486a9da5e630e9986"
format_stamp: "Formatted at 2026-08-09 06:31:47 on dist-test-slave-cvwc"
server_key: "61e35221fdfe36375a4921448021cb2b"
server_key_iv: "ecd66ca33c57b06ba34f75b32824ab1d"
server_key_version: "encryptionkey@0"
I20260809 06:31:47.680655 2588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:47.706728 2588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:47.710675 2588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:47.710950 2588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:47.711860 2588 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:47.713133 2588 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:47.713212 2588 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:47.713326 2588 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:47.713380 2588 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:47.742611 2588 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:45915
I20260809 06:31:47.742666 2777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:45915 every 8 connection(s)
I20260809 06:31:47.743836 2588 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:31:47.750990 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 2588
I20260809 06:31:47.751199 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:31:47.751606 31033 external_mini_cluster.cc:1428] Setting key 4bc9780bd7d41c1d70630b6eaa0be101
Aug 09 06:31:47 dist-test-slave-cvwc krb5kdc[2243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257107, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:47.763370 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:47.746275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:52793 (local address 127.30.78.126:40243)
0809 06:31:47.746449 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:47.746454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:47.747553 (+ 1099us) server_negotiation.cc:407] Connection header received
0809 06:31:47.749310 (+ 1757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:47.749316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:47.749393 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:47.749478 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:47.751137 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:47.751933 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:47.753446 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:47.753896 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:47.753994 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:47.757888 (+ 3894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:47.757893 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:47.757896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:47.757928 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:47.760380 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:47.761127 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:47.761132 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:47.761136 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:47.761290 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:47.761647 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:47.761651 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:47.761654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:47.762011 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:47.762147 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:47.762789 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 06:31:47.763016 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:31:47.764197 2783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:47.746711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:40243 (local address 127.30.78.66:52793)
0809 06:31:47.747398 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:47.747438 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:47.749050 (+ 1612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:47.749741 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:47.749753 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:47.750253 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:47.750919 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:47.750946 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:47.752088 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:47.752093 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:47.753304 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:47.753321 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:47.754108 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:47.754115 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:47.754405 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:47.755082 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:47.755110 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:47.757653 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:47.760513 (+ 2860us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:47.760522 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:47.760539 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:47.761012 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:47.761383 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:47.761386 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:47.761389 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:47.761556 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:47.762115 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:47.762120 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:47.762416 (+ 296us) client_negotiation.cc:769] Sending connection context
0809 06:31:47.762648 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 06:31:47.763031 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":264,"threads_started":1}
I20260809 06:31:47.765587 2778 heartbeater.cc:347] Connected to a master server at 127.30.78.126:40243
I20260809 06:31:47.765909 2778 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:47.766582 2778 heartbeater.cc:511] Master 127.30.78.126:40243 requested a full tablet report, sending...
I20260809 06:31:47.768079 2309 ts_manager.cc:194] Registered new tserver with Master: 72d201f8d28b442486a9da5e630e9986 (127.30.78.66:45915)
I20260809 06:31:47.769208 2309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:52793
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:31:47.792290 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40243
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:37669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:48.103768 2789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:48.104012 2789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:48.104144 2789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:48.111086 2789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:48.111187 2789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:48.111340 2789 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:31:48.120640 2789 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:37669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40243
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:48.121901 2789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:48.123200 2789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:48.135706 2801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:48.135641 2804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:48.135737 2800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:48.136471 2789 server_base.cc:1034] running on GCE node
I20260809 06:31:48.137140 2789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:48.138046 2789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:48.139235 2789 hybrid_clock.cc:648] HybridClock initialized: now 1786257108139194 us; error 33 us; skew 500 ppm
I20260809 06:31:48.139513 2789 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:48 dist-test-slave-cvwc krb5kdc[2243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257108, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:48.142516 2789 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:31:48.143827 2789 webserver.cc:460] Webserver started at http://127.30.78.67:40411/ using document root <none> and password file <none>
I20260809 06:31:48.144446 2789 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:48.144569 2789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:48.144874 2789 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:48.147650 2789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "795d379b088b490e801c54f1220d1019"
format_stamp: "Formatted at 2026-08-09 06:31:48 on dist-test-slave-cvwc"
server_key: "101af672ca275f7fce7e12a6c60bc2a1"
server_key_iv: "cdad09909e3a5546f6efe74c2d6ecbba"
server_key_version: "encryptionkey@0"
I20260809 06:31:48.148415 2789 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "795d379b088b490e801c54f1220d1019"
format_stamp: "Formatted at 2026-08-09 06:31:48 on dist-test-slave-cvwc"
server_key: "101af672ca275f7fce7e12a6c60bc2a1"
server_key_iv: "cdad09909e3a5546f6efe74c2d6ecbba"
server_key_version: "encryptionkey@0"
I20260809 06:31:48.153107 2789 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 06:31:48.156279 2813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:48.157454 2789 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:31:48.157601 2789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "795d379b088b490e801c54f1220d1019"
format_stamp: "Formatted at 2026-08-09 06:31:48 on dist-test-slave-cvwc"
server_key: "101af672ca275f7fce7e12a6c60bc2a1"
server_key_iv: "cdad09909e3a5546f6efe74c2d6ecbba"
server_key_version: "encryptionkey@0"
I20260809 06:31:48.157832 2789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:48.182276 2789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:48.186717 2789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:48.187000 2789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:48.187937 2789 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:48.189278 2789 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:48.189366 2789 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:48.189495 2789 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:48.189558 2789 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:48.221657 2789 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:44301
I20260809 06:31:48.221689 2970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:44301 every 8 connection(s)
I20260809 06:31:48.223127 2789 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:31:48.226797 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 2789
I20260809 06:31:48.226999 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:31:48.227435 31033 external_mini_cluster.cc:1428] Setting key 3a30dc58e00d7555e454388cec21e88b
Aug 09 06:31:48 dist-test-slave-cvwc krb5kdc[2243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257108, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:48.242295 2582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:48.225513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:33507 (local address 127.30.78.126:40243)
0809 06:31:48.225686 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:48.225691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:48.226893 (+ 1202us) server_negotiation.cc:407] Connection header received
0809 06:31:48.228828 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:48.228835 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:48.228916 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:48.229001 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:48.230732 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:48.231469 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:48.232943 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:48.233350 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:48.233463 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:48.236980 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:48.236986 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:48.236991 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:48.237025 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:48.239431 (+ 2406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:48.240098 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:48.240102 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:48.240105 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:48.240224 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:48.240620 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:48.240624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:48.240626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:48.240887 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:48.241018 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:48.241677 (+ 659us) server_negotiation.cc:299] Negotiation successful
0809 06:31:48.241971 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:31:48.243111 2975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:48.226020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:40243 (local address 127.30.78.67:33507)
0809 06:31:48.226723 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:48.226767 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:48.228575 (+ 1808us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:48.229239 (+ 664us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:48.229247 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:48.230006 (+ 759us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:48.230573 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:48.230589 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:48.231620 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:48.231624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:48.232806 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:48.232818 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:48.233563 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:48.233571 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:48.233823 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:48.234432 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:48.234455 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:48.236747 (+ 2292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:48.239557 (+ 2810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:48.239566 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:48.239581 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:48.239978 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:48.240323 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:48.240328 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:48.240332 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:48.240506 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:48.241017 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:48.241024 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:48.241307 (+ 283us) client_negotiation.cc:769] Sending connection context
0809 06:31:48.241531 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 06:31:48.242036 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":271,"threads_started":1}
I20260809 06:31:48.244202 2971 heartbeater.cc:347] Connected to a master server at 127.30.78.126:40243
I20260809 06:31:48.244472 2971 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:48.245122 2971 heartbeater.cc:511] Master 127.30.78.126:40243 requested a full tablet report, sending...
I20260809 06:31:48.246424 2309 ts_manager.cc:194] Registered new tserver with Master: 795d379b088b490e801c54f1220d1019 (127.30.78.67:44301)
I20260809 06:31:48.247186 2309 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:33507
I20260809 06:31:48.254127 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 06:31:48.285384 2582 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:31:48.283129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59790 (local address 127.30.78.126:40243)
0809 06:31:48.283290 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:48.283294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:48.283751 (+ 457us) server_negotiation.cc:407] Connection header received
0809 06:31:48.283926 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:48.283931 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:48.283995 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:48.284070 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:48.285177 (+ 1107us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59790: BlockingRecv error: recv got EOF from 127.0.0.1:59790 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:31:48.288538 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 2409
W20260809 06:31:48.291025 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 2409: Not authorized: Client connection negotiation failed: client connection to 127.30.78.65:39495: server requires authentication, but client does not have Kerberos credentials available
I20260809 06:31:48.291164 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 2409
I20260809 06:31:48.310055 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 2588
W20260809 06:31:48.312350 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 2588: Not authorized: Client connection negotiation failed: client connection to 127.30.78.66:45915: server requires authentication, but client does not have Kerberos credentials available
I20260809 06:31:48.312481 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 2588
I20260809 06:31:48.327739 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 2789
W20260809 06:31:48.330515 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 2789: Not authorized: Client connection negotiation failed: client connection to 127.30.78.67:44301: server requires authentication, but client does not have Kerberos credentials available
I20260809 06:31:48.330626 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 2789
I20260809 06:31:48.348901 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 2261
I20260809 06:31:48.349972 2359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:48.449294 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 2261
2026-08-09T06:31:48Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3498 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:31:48 dist-test-slave-cvwc krb5kdc[2995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:31:48 dist-test-slave-cvwc krb5kdc[2995](info): set up 2 sockets
Aug 09 06:31:48 dist-test-slave-cvwc krb5kdc[2995](info): commencing operation
krb5kdc: starting...
W20260809 06:31:49.635221 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.003s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:31:49 dist-test-slave-cvwc krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:31:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:31:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:31:49.813156 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33525
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:33525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:50.121563 3016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:50.121882 3016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:50.122028 3016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:50.128918 3016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:31:50.129014 3016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:50.129091 3016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:50.129170 3016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:31:50.129237 3016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:31:50.138484 3016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:33525
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:50.139586 3016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:50.140823 3016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:50.151429 3022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:50.151494 3025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:50.151470 3023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:50.152455 3016 server_base.cc:1034] running on GCE node
I20260809 06:31:50.153115 3016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:50.154327 3016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:50.155511 3016 hybrid_clock.cc:648] HybridClock initialized: now 1786257110155475 us; error 26 us; skew 500 ppm
I20260809 06:31:50.155814 3016 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:50 dist-test-slave-cvwc krb5kdc[2995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257110, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:50.161934 3016 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:31:50.163262 3016 webserver.cc:460] Webserver started at http://127.30.78.126:45513/ using document root <none> and password file <none>
I20260809 06:31:50.163861 3016 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:50.163980 3016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:50.164268 3016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:50.167068 3016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "e349407980904555bd709aa0d17f4cb2"
format_stamp: "Formatted at 2026-08-09 06:31:50 on dist-test-slave-cvwc"
server_key: "be1846dabf269e10fb7328c75804330d"
server_key_iv: "5bacfaa64c0582a1bbfa959d4684452e"
server_key_version: "encryptionkey@0"
I20260809 06:31:50.167788 3016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "e349407980904555bd709aa0d17f4cb2"
format_stamp: "Formatted at 2026-08-09 06:31:50 on dist-test-slave-cvwc"
server_key: "be1846dabf269e10fb7328c75804330d"
server_key_iv: "5bacfaa64c0582a1bbfa959d4684452e"
server_key_version: "encryptionkey@0"
I20260809 06:31:50.172394 3016 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:31:50.175493 3034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:50.176635 3016 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:31:50.176774 3016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "e349407980904555bd709aa0d17f4cb2"
format_stamp: "Formatted at 2026-08-09 06:31:50 on dist-test-slave-cvwc"
server_key: "be1846dabf269e10fb7328c75804330d"
server_key_iv: "5bacfaa64c0582a1bbfa959d4684452e"
server_key_version: "encryptionkey@0"
I20260809 06:31:50.176944 3016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:50.189702 3016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:50.193349 3016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:50.193581 3016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:50.210218 3016 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:33525
I20260809 06:31:50.210259 3112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:33525 every 8 connection(s)
I20260809 06:31:50.211525 3016 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:31:50.215123 3113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:50.217006 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 3016
I20260809 06:31:50.217255 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:31:50.218060 31033 external_mini_cluster.cc:1428] Setting key 94326cf0950cb43ad15902ed722e1927
I20260809 06:31:50.229077 3113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2: Bootstrap starting.
Aug 09 06:31:50 dist-test-slave-cvwc krb5kdc[2995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:50.232625 3113 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:50.233635 3113 log.cc:824] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:50.236194 3113 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2: No bootstrap required, opened a new log
I20260809 06:31:50.239559 3116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:50.219882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49858 (local address 127.30.78.126:33525)
0809 06:31:50.220658 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:50.220672 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:50.220721 (+ 49us) server_negotiation.cc:407] Connection header received
0809 06:31:50.222302 (+ 1581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:50.222328 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:50.222707 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:50.223003 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:50.224774 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:50.226096 (+ 1322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:50.227823 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:50.228447 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:50.228569 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:50.232864 (+ 4295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:50.232871 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:50.232891 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:50.232934 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:50.235776 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:50.236415 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:50.236422 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:50.236427 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:50.236600 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:50.237020 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:50.237023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:50.237025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:50.237506 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:50.237735 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:50.238242 (+ 507us) server_negotiation.cc:299] Negotiation successful
0809 06:31:50.238603 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":363,"threads_started":1}
I20260809 06:31:50.243237 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:31:50.244508 3113 raft_consensus.cc:348] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e349407980904555bd709aa0d17f4cb2" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33525 } }
I20260809 06:31:50.244829 3113 raft_consensus.cc:374] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:50.244918 3113 raft_consensus.cc:729] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e349407980904555bd709aa0d17f4cb2, State: Initialized, Role: FOLLOWER
I20260809 06:31:50.245398 3113 consensus_queue.cc:260] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e349407980904555bd709aa0d17f4cb2" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33525 } }
I20260809 06:31:50.245606 3113 raft_consensus.cc:388] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:31:50.245738 3113 raft_consensus.cc:482] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:31:50.245900 3113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:50.247864 3113 raft_consensus.cc:504] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e349407980904555bd709aa0d17f4cb2" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33525 } }
I20260809 06:31:50.248310 3113 leader_election.cc:302] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e349407980904555bd709aa0d17f4cb2; no voters:
I20260809 06:31:50.248840 3113 leader_election.cc:288] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:31:50.248968 3121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:50.250598 3121 raft_consensus.cc:686] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [term 1 LEADER]: Becoming Leader. State: Replica: e349407980904555bd709aa0d17f4cb2, State: Running, Role: LEADER
I20260809 06:31:50.250768 3113 sys_catalog.cc:564] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:31:50.251129 3121 consensus_queue.cc:237] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e349407980904555bd709aa0d17f4cb2" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33525 } }
I20260809 06:31:50.254233 3127 sys_catalog.cc:455] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e349407980904555bd709aa0d17f4cb2. Latest consensus state: current_term: 1 leader_uuid: "e349407980904555bd709aa0d17f4cb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e349407980904555bd709aa0d17f4cb2" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33525 } } }
I20260809 06:31:50.254209 3123 sys_catalog.cc:455] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e349407980904555bd709aa0d17f4cb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e349407980904555bd709aa0d17f4cb2" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33525 } } }
I20260809 06:31:50.254657 3127 sys_catalog.cc:458] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:50.254729 3123 sys_catalog.cc:458] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:50.255496 3137 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:31:50.271267 3137 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:31:50.292268 3137 catalog_manager.cc:1347] Generated new cluster ID: 74eb6d1c8cfc4281b53c15109277e169
I20260809 06:31:50.292393 3137 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:31:50.308308 3137 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:31:50.310110 3137 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:31:50.319314 3161 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 06:31:50.320688 3137 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e349407980904555bd709aa0d17f4cb2: Generated new TSK 0
I20260809 06:31:50.321622 3137 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:31:50.322521 3116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:50.302369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49868 (local address 127.30.78.126:33525)
0809 06:31:50.302545 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:50.302551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:50.313201 (+ 10650us) server_negotiation.cc:407] Connection header received
0809 06:31:50.313695 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:50.313702 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:50.313811 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:50.313899 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:50.315464 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:50.316653 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:50.318763 (+ 2110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:50.319468 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:50.319557 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:50.321045 (+ 1488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:50.321050 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:50.321053 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:31:50.321659 (+ 606us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:50.321764 (+ 105us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:31:50.321794 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:50.321900 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:50.322062 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 06:31:50.322157 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:31:50.334533 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 3016
I20260809 06:31:50.335616 3103 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:50.423326 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 3016
2026-08-09T06:31:50Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1966 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:31:50 dist-test-slave-cvwc krb5kdc[3168](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:31:50 dist-test-slave-cvwc krb5kdc[3168](info): set up 2 sockets
Aug 09 06:31:50 dist-test-slave-cvwc krb5kdc[3168](info): commencing operation
krb5kdc: starting...
W20260809 06:31:51.617113 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.001s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:31:51 dist-test-slave-cvwc krb5kdc[3168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:31:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:31:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:31:51.792214 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36907
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:36907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:52.100247 3185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:52.100510 3185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:52.100641 3185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:52.107625 3185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:31:52.107725 3185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:52.107801 3185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:52.107885 3185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:31:52.107949 3185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:31:52.118288 3185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:36907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:52.119493 3185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:52.120721 3185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:52.131614 3192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:52.131546 3193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:52.131584 3196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:52.132616 3185 server_base.cc:1034] running on GCE node
I20260809 06:31:52.133294 3185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:52.134609 3185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:52.135802 3185 hybrid_clock.cc:648] HybridClock initialized: now 1786257112135759 us; error 27 us; skew 500 ppm
I20260809 06:31:52.136116 3185 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:52 dist-test-slave-cvwc krb5kdc[3168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257112, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:52.139045 3185 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:31:52.140334 3185 webserver.cc:460] Webserver started at http://127.30.78.126:42631/ using document root <none> and password file <none>
I20260809 06:31:52.140954 3185 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:52.141067 3185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:52.141345 3185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:52.144240 3185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "ee5777c9ceec4ef292f19c3c0bb117ad"
format_stamp: "Formatted at 2026-08-09 06:31:52 on dist-test-slave-cvwc"
server_key: "4bd2985daa92cad26ef735df9cbfb2d3"
server_key_iv: "176a1e4ebdeb6ea575aa6dcffc583289"
server_key_version: "encryptionkey@0"
I20260809 06:31:52.144965 3185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "ee5777c9ceec4ef292f19c3c0bb117ad"
format_stamp: "Formatted at 2026-08-09 06:31:52 on dist-test-slave-cvwc"
server_key: "4bd2985daa92cad26ef735df9cbfb2d3"
server_key_iv: "176a1e4ebdeb6ea575aa6dcffc583289"
server_key_version: "encryptionkey@0"
I20260809 06:31:52.149665 3185 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:31:52.152772 3208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:52.154016 3185 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 06:31:52.154168 3185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "ee5777c9ceec4ef292f19c3c0bb117ad"
format_stamp: "Formatted at 2026-08-09 06:31:52 on dist-test-slave-cvwc"
server_key: "4bd2985daa92cad26ef735df9cbfb2d3"
server_key_iv: "176a1e4ebdeb6ea575aa6dcffc583289"
server_key_version: "encryptionkey@0"
I20260809 06:31:52.154335 3185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:52.177584 3185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:52.181104 3185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:52.181348 3185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:52.197552 3185 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:36907
I20260809 06:31:52.197570 3275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:36907 every 8 connection(s)
I20260809 06:31:52.198815 3185 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:31:52.202280 3276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:52.207930 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 3185
I20260809 06:31:52.208113 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:31:52.208721 31033 external_mini_cluster.cc:1428] Setting key 61f8b27780b8e0f844dd1ff5b69598f9
I20260809 06:31:52.212733 3276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad: Bootstrap starting.
I20260809 06:31:52.216420 3276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:52.217805 3276 log.cc:824] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:52.221031 3276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad: No bootstrap required, opened a new log
Aug 09 06:31:52 dist-test-slave-cvwc krb5kdc[3168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:52.229905 3276 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5777c9ceec4ef292f19c3c0bb117ad" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36907 } }
I20260809 06:31:52.230376 3276 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:52.230504 3276 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee5777c9ceec4ef292f19c3c0bb117ad, State: Initialized, Role: FOLLOWER
I20260809 06:31:52.231237 3276 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5777c9ceec4ef292f19c3c0bb117ad" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36907 } }
I20260809 06:31:52.231464 3276 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:31:52.231607 3276 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:31:52.231781 3276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:52.232010 3279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:52.210689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60386 (local address 127.30.78.126:36907)
0809 06:31:52.211476 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:52.211492 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:52.211539 (+ 47us) server_negotiation.cc:407] Connection header received
0809 06:31:52.213783 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:52.213808 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:52.214282 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:52.214746 (+ 464us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:52.215927 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:52.217995 (+ 2068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:52.219519 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:52.220524 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:52.220713 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:52.224799 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:52.224806 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:52.224820 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:52.224866 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:52.227800 (+ 2934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:52.228590 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:52.228596 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:52.228602 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:52.228774 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:52.229211 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:52.229215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:52.229216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:52.229736 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:52.229987 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:52.230450 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 06:31:52.230867 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":334,"threads_started":1}
I20260809 06:31:52.234591 3276 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5777c9ceec4ef292f19c3c0bb117ad" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36907 } }
I20260809 06:31:52.235124 3276 leader_election.cc:302] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee5777c9ceec4ef292f19c3c0bb117ad; no voters:
I20260809 06:31:52.235646 3276 leader_election.cc:288] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:31:52.235760 3285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:52.236410 3285 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [term 1 LEADER]: Becoming Leader. State: Replica: ee5777c9ceec4ef292f19c3c0bb117ad, State: Running, Role: LEADER
I20260809 06:31:52.237042 3285 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5777c9ceec4ef292f19c3c0bb117ad" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36907 } }
I20260809 06:31:52.237692 3276 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:31:52.239637 3287 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee5777c9ceec4ef292f19c3c0bb117ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5777c9ceec4ef292f19c3c0bb117ad" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36907 } } }
I20260809 06:31:52.239993 3287 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:52.240993 3286 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee5777c9ceec4ef292f19c3c0bb117ad. Latest consensus state: current_term: 1 leader_uuid: "ee5777c9ceec4ef292f19c3c0bb117ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee5777c9ceec4ef292f19c3c0bb117ad" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36907 } } }
I20260809 06:31:52.242193 3286 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:52.247049 3297 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:31:52.252182 3297 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:31:52.260614 3297 catalog_manager.cc:1347] Generated new cluster ID: fa7fa6730b1f4a619aeb2385f80bd6c3
I20260809 06:31:52.260759 3297 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:31:52.294293 3297 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:31:52.296120 3297 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:31:52.312139 3297 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee5777c9ceec4ef292f19c3c0bb117ad: Generated new TSK 0
I20260809 06:31:52.313126 3297 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:31:52.368577 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36907
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:52.686561 3316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:52.686849 3316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:52.686968 3316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:52.693962 3316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:52.694054 3316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:52.694182 3316 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:31:52.703481 3316 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:52.704713 3316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:52.706071 3316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:52.718176 3321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:52.718135 3325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:52.718222 3322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:52.718880 3316 server_base.cc:1034] running on GCE node
I20260809 06:31:52.719486 3316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:52.720316 3316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:52.721504 3316 hybrid_clock.cc:648] HybridClock initialized: now 1786257112721468 us; error 31 us; skew 500 ppm
I20260809 06:31:52.721798 3316 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:52 dist-test-slave-cvwc krb5kdc[3168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257112, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:52.724740 3316 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:31:52.726030 3316 webserver.cc:460] Webserver started at http://127.30.78.65:40913/ using document root <none> and password file <none>
I20260809 06:31:52.726652 3316 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:52.726759 3316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:52.727041 3316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:52.729898 3316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "c3819f1a17184701937ab06c3eb7550d"
format_stamp: "Formatted at 2026-08-09 06:31:52 on dist-test-slave-cvwc"
server_key: "0883b2d325f27900f7fd7157fa9c5b81"
server_key_iv: "d55f6c688df93ccfb348268cd87180e5"
server_key_version: "encryptionkey@0"
I20260809 06:31:52.730664 3316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "c3819f1a17184701937ab06c3eb7550d"
format_stamp: "Formatted at 2026-08-09 06:31:52 on dist-test-slave-cvwc"
server_key: "0883b2d325f27900f7fd7157fa9c5b81"
server_key_iv: "d55f6c688df93ccfb348268cd87180e5"
server_key_version: "encryptionkey@0"
I20260809 06:31:52.735401 3316 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:31:52.738577 3334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:52.739799 3316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:31:52.739935 3316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "c3819f1a17184701937ab06c3eb7550d"
format_stamp: "Formatted at 2026-08-09 06:31:52 on dist-test-slave-cvwc"
server_key: "0883b2d325f27900f7fd7157fa9c5b81"
server_key_iv: "d55f6c688df93ccfb348268cd87180e5"
server_key_version: "encryptionkey@0"
I20260809 06:31:52.740098 3316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:52.756830 3316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:52.760900 3316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:52.761152 3316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:52.762089 3316 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:52.763340 3316 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:52.763419 3316 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:52.763541 3316 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:52.763595 3316 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:52.793146 3316 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:45113
I20260809 06:31:52.793201 3494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:45113 every 8 connection(s)
I20260809 06:31:52.794422 3316 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:31:52.804518 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 3316
I20260809 06:31:52.804695 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:31:52.805404 31033 external_mini_cluster.cc:1428] Setting key 22a998f90fd8532addd75b7dd0b671ab
Aug 09 06:31:52 dist-test-slave-cvwc krb5kdc[3168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257112, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:52.813508 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:52.796768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:47077 (local address 127.30.78.126:36907)
0809 06:31:52.797202 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:52.797207 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:52.798033 (+ 826us) server_negotiation.cc:407] Connection header received
0809 06:31:52.799788 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:52.799794 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:52.799871 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:52.799979 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:52.801403 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:52.802168 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:52.803665 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:52.804055 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:52.804164 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:52.807636 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:52.807642 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:52.807647 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:52.807688 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:52.810624 (+ 2936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:52.811272 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:52.811277 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:52.811280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:52.811443 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:52.811860 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:52.811865 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:52.811867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:52.812166 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:52.812345 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:52.813085 (+ 740us) server_negotiation.cc:299] Negotiation successful
0809 06:31:52.813243 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":227,"threads_started":1}
I20260809 06:31:52.814699 3501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:52.797157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36907 (local address 127.30.78.65:47077)
0809 06:31:52.797869 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:52.797915 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:52.799518 (+ 1603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:52.800216 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:52.800224 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:52.800705 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:52.801229 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:52.801246 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:52.802321 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:52.802325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:52.803526 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:52.803539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:52.804289 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:52.804297 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:52.804518 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:52.805171 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:52.805197 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:52.807420 (+ 2223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:52.810742 (+ 3322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:52.810748 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:52.810759 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:52.811160 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:52.811549 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:52.811552 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:52.811554 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:52.811728 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:52.812322 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:52.812330 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:52.812720 (+ 390us) client_negotiation.cc:769] Sending connection context
0809 06:31:52.813009 (+ 289us) client_negotiation.cc:240] Negotiation successful
0809 06:31:52.813478 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":267,"threads_started":1}
I20260809 06:31:52.816090 3495 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36907
I20260809 06:31:52.816401 3495 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:52.817188 3495 heartbeater.cc:511] Master 127.30.78.126:36907 requested a full tablet report, sending...
I20260809 06:31:52.819274 3232 ts_manager.cc:194] Registered new tserver with Master: c3819f1a17184701937ab06c3eb7550d (127.30.78.65:45113)
I20260809 06:31:52.820626 3232 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:47077
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:31:52.854638 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36907
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:53.161150 3504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:53.161408 3504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:53.161537 3504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:53.168411 3504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:53.168509 3504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:53.168660 3504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:31:53.177781 3504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:53.178946 3504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:53.180124 3504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:53.191967 3510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:53.191998 3511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:53.192068 3516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:53.192592 3504 server_base.cc:1034] running on GCE node
I20260809 06:31:53.193184 3504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:53.194062 3504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:53.195247 3504 hybrid_clock.cc:648] HybridClock initialized: now 1786257113195200 us; error 40 us; skew 500 ppm
I20260809 06:31:53.195514 3504 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:53 dist-test-slave-cvwc krb5kdc[3168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257113, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:53.198583 3504 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:31:53.200914 3504 webserver.cc:460] Webserver started at http://127.30.78.66:45315/ using document root <none> and password file <none>
I20260809 06:31:53.201563 3504 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:53.201676 3504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:53.201974 3504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:53.204622 3504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "4df24a9c0dec43e0adffcf791409425b"
format_stamp: "Formatted at 2026-08-09 06:31:53 on dist-test-slave-cvwc"
server_key: "8a34f41ef607da846c381cd4b5493930"
server_key_iv: "d84d16832270da91090906267f6465e3"
server_key_version: "encryptionkey@0"
I20260809 06:31:53.205332 3504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "4df24a9c0dec43e0adffcf791409425b"
format_stamp: "Formatted at 2026-08-09 06:31:53 on dist-test-slave-cvwc"
server_key: "8a34f41ef607da846c381cd4b5493930"
server_key_iv: "d84d16832270da91090906267f6465e3"
server_key_version: "encryptionkey@0"
I20260809 06:31:53.210146 3504 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:31:53.213215 3523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:53.214442 3504 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:31:53.214587 3504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "4df24a9c0dec43e0adffcf791409425b"
format_stamp: "Formatted at 2026-08-09 06:31:53 on dist-test-slave-cvwc"
server_key: "8a34f41ef607da846c381cd4b5493930"
server_key_iv: "d84d16832270da91090906267f6465e3"
server_key_version: "encryptionkey@0"
I20260809 06:31:53.214756 3504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:53.238078 3504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:53.242141 3504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:53.242416 3504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:53.243422 3504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:53.244809 3504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:53.244889 3504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:53.245008 3504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:53.245067 3504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:53.274209 3504 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:37305
I20260809 06:31:53.274274 3687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:37305 every 8 connection(s)
I20260809 06:31:53.275414 3504 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:31:53.279649 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 3504
I20260809 06:31:53.279830 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:31:53.280233 31033 external_mini_cluster.cc:1428] Setting key a01ede34dc2df0ae461236fe9f63131a
Aug 09 06:31:53 dist-test-slave-cvwc krb5kdc[3168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257113, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:53.294526 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:53.277783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:36065 (local address 127.30.78.126:36907)
0809 06:31:53.277961 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:53.277966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:53.279089 (+ 1123us) server_negotiation.cc:407] Connection header received
0809 06:31:53.280960 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:53.280966 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:53.281053 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:53.281166 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:53.282888 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.283624 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.285106 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.285519 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.285625 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:53.289057 (+ 3432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:53.289062 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:53.289065 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:53.289097 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:53.291574 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.292392 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.292396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.292398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.292515 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.292971 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.292974 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.292976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.293207 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:53.293324 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:53.294126 (+ 802us) server_negotiation.cc:299] Negotiation successful
0809 06:31:53.294286 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:31:53.295903 3690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:53.278252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36907 (local address 127.30.78.66:36065)
0809 06:31:53.278945 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:53.278981 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:53.280654 (+ 1673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:53.281406 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:53.281416 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:53.282144 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:53.282728 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:53.282744 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.283772 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.283776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:53.284968 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:53.284981 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.285752 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.285760 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:53.285975 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:53.286564 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:53.286586 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:53.288835 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:53.291712 (+ 2877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:53.291722 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:53.291751 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:53.292286 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:53.292608 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:53.292612 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:53.292615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:53.292878 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:53.293327 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:53.293335 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:53.293741 (+ 406us) client_negotiation.cc:769] Sending connection context
0809 06:31:53.294050 (+ 309us) client_negotiation.cc:240] Negotiation successful
0809 06:31:53.294542 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":279,"threads_started":1}
I20260809 06:31:53.297251 3688 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36907
I20260809 06:31:53.297586 3688 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:53.298496 3688 heartbeater.cc:511] Master 127.30.78.126:36907 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
I20260809 06:31:53.300037 3232 ts_manager.cc:194] Registered new tserver with Master: 4df24a9c0dec43e0adffcf791409425b (127.30.78.66:37305)
I20260809 06:31:53.300853 3232 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:36065
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:31:53.324097 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36907
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:53.640594 3693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:53.640857 3693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:53.640982 3693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:53.648103 3693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:53.648201 3693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:53.648347 3693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:31:53.657444 3693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36907
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:53.658658 3693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:53.659858 3693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:53.671741 3700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:53.671756 3701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:53.671765 3703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:53.672838 3693 server_base.cc:1034] running on GCE node
I20260809 06:31:53.673384 3693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:53.674247 3693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:53.675443 3693 hybrid_clock.cc:648] HybridClock initialized: now 1786257113675401 us; error 29 us; skew 500 ppm
I20260809 06:31:53.675722 3693 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:53 dist-test-slave-cvwc krb5kdc[3168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257113, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:53.678671 3693 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:31:53.680007 3693 webserver.cc:460] Webserver started at http://127.30.78.67:35347/ using document root <none> and password file <none>
I20260809 06:31:53.680609 3693 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:53.680727 3693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:53.681008 3693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:53.683817 3693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "847e5c0496a9484ab86dc233c6215b08"
format_stamp: "Formatted at 2026-08-09 06:31:53 on dist-test-slave-cvwc"
server_key: "b395e2869246b0519d5caaeafb223a16"
server_key_iv: "b772ea0fc31a029b6b26f8d6e7025649"
server_key_version: "encryptionkey@0"
I20260809 06:31:53.684579 3693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "847e5c0496a9484ab86dc233c6215b08"
format_stamp: "Formatted at 2026-08-09 06:31:53 on dist-test-slave-cvwc"
server_key: "b395e2869246b0519d5caaeafb223a16"
server_key_iv: "b772ea0fc31a029b6b26f8d6e7025649"
server_key_version: "encryptionkey@0"
I20260809 06:31:53.689323 3693 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:31:53.692472 3711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:53.693625 3693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:31:53.693794 3693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "847e5c0496a9484ab86dc233c6215b08"
format_stamp: "Formatted at 2026-08-09 06:31:53 on dist-test-slave-cvwc"
server_key: "b395e2869246b0519d5caaeafb223a16"
server_key_iv: "b772ea0fc31a029b6b26f8d6e7025649"
server_key_version: "encryptionkey@0"
I20260809 06:31:53.693980 3693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:53.707036 3693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:53.710917 3693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:53.711174 3693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:53.712033 3693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:53.713353 3693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:53.713434 3693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:53.713549 3693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:53.713606 3693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:53.743227 3693 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:40681
I20260809 06:31:53.743278 3868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:40681 every 8 connection(s)
I20260809 06:31:53.744484 3693 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:31:53.747943 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 3693
I20260809 06:31:53.748119 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:31:53.748729 31033 external_mini_cluster.cc:1428] Setting key 99bfc8acb86c9a7bb77680c0d108103c
Aug 09 06:31:53 dist-test-slave-cvwc krb5kdc[3168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257113, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:53.763669 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:53.746865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:35737 (local address 127.30.78.126:36907)
0809 06:31:53.747076 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:53.747080 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:53.748367 (+ 1287us) server_negotiation.cc:407] Connection header received
0809 06:31:53.750672 (+ 2305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:53.750677 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:53.750744 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:53.750840 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:53.752376 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.753110 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.754603 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.755016 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.755107 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:53.758318 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:53.758324 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:53.758329 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:53.758368 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:53.760807 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.761401 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.761404 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.761407 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.761513 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.761891 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.761894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.761896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.762182 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:53.762319 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:53.763127 (+ 808us) server_negotiation.cc:299] Negotiation successful
0809 06:31:53.763330 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260809 06:31:53.764566 3875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:53.747332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36907 (local address 127.30.78.67:35737)
0809 06:31:53.748201 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:53.748247 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:53.750399 (+ 2152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:53.751035 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:53.751042 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:53.751604 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:53.752230 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:53.752249 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.753231 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.753235 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:53.754494 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:53.754506 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.755177 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.755181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:53.755361 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:53.755926 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:53.755947 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:53.758141 (+ 2194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:53.760920 (+ 2779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:53.760926 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:53.760937 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:53.761312 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:53.761586 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:53.761589 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:53.761591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:53.761803 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:53.762330 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:53.762338 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:53.762716 (+ 378us) client_negotiation.cc:769] Sending connection context
0809 06:31:53.763016 (+ 300us) client_negotiation.cc:240] Negotiation successful
0809 06:31:53.763479 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":295,"threads_started":1}
I20260809 06:31:53.765707 3873 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36907
I20260809 06:31:53.766006 3873 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:53.766659 3873 heartbeater.cc:511] Master 127.30.78.126:36907 requested a full tablet report, sending...
I20260809 06:31:53.767902 3232 ts_manager.cc:194] Registered new tserver with Master: 847e5c0496a9484ab86dc233c6215b08 (127.30.78.67:40681)
I20260809 06:31:53.768692 3232 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:35737
I20260809 06:31:53.775701 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:31:53 dist-test-slave-cvwc krb5kdc[3168](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257113, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 09 06:31:53 dist-test-slave-cvwc krb5kdc[3168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257113, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:53.821816 3497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:53.808990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40212 (local address 127.30.78.126:36907)
0809 06:31:53.809147 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:53.809152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:53.809644 (+ 492us) server_negotiation.cc:407] Connection header received
0809 06:31:53.809808 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:53.809812 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:53.809883 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:53.809974 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:53.811443 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.812190 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.813374 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.813830 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.813930 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:53.817366 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:53.817370 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:53.817374 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:53.817407 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:53.819774 (+ 2367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.820298 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.820302 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.820304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.820430 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.820694 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.820697 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.820699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.820998 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:53.821167 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:53.821369 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 06:31:53.821521 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 06:31:53.822371 3232 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40212
I20260809 06:31:53.823894 3495 heartbeater.cc:503] Master 127.30.78.126:36907 was elected leader, sending a full tablet report...
I20260809 06:31:53.824107 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 3316
Aug 09 06:31:53 dist-test-slave-cvwc krb5kdc[3168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257113, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:31:53.838835 3886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:53.825078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55830 (local address 127.30.78.65:45113)
0809 06:31:53.826119 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:53.826126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:53.826149 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:31:53.826195 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:53.826201 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:53.826390 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:53.826506 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:53.827501 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.828475 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.829537 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.830127 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.830217 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:53.833689 (+ 3472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:53.833700 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:53.833761 (+ 61us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:53.833793 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:53.836211 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.836797 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.836803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.836805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.836932 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.837266 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.837269 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.837271 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.837658 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:53.837964 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:53.838225 (+ 261us) server_negotiation.cc:299] Negotiation successful
0809 06:31:53.838471 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":909,"thread_start_us":767,"threads_started":1}
W20260809 06:31:53.839969 3490 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55830
W20260809 06:31:53.840942 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 3316: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:31:53.841120 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 3316
I20260809 06:31:53.859014 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 3504
Aug 09 06:31:53 dist-test-slave-cvwc krb5kdc[3168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257113, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:31:53.872768 3887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:53.859779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51164 (local address 127.30.78.66:37305)
0809 06:31:53.860242 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:53.860248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:53.860271 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:31:53.860329 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:53.860335 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:53.860527 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:53.860663 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:53.861847 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.862824 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.863946 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.864464 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.864558 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:53.868206 (+ 3648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:53.868216 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:53.868228 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:53.868265 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:53.870670 (+ 2405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.871188 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.871193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.871195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.871311 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.871584 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.871587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.871589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.871898 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:53.872116 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:53.872305 (+ 189us) server_negotiation.cc:299] Negotiation successful
0809 06:31:53.872491 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":217,"threads_started":1}
W20260809 06:31:53.873932 3679 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51164
W20260809 06:31:53.874904 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 3504: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:31:53.875028 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 3504
I20260809 06:31:53.896413 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 3693
Aug 09 06:31:53 dist-test-slave-cvwc krb5kdc[3168](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257113, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:31:53.911218 3888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:53.897372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38372 (local address 127.30.78.67:40681)
0809 06:31:53.897996 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:53.898003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:53.898031 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:31:53.898089 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:53.898096 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:53.898290 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:53.898447 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:53.899673 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.900658 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.901892 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:53.902419 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:53.902509 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:53.906361 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:53.906372 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:53.906384 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:53.906426 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:53.909027 (+ 2601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.909546 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.909552 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.909554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.909662 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:53.909984 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:53.909987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:53.909989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:53.910290 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:53.910521 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:53.910691 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 06:31:53.910876 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":320,"threads_started":1}
W20260809 06:31:53.912388 3861 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:38372
W20260809 06:31:53.913393 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 3693: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:31:53.913535 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 3693
I20260809 06:31:53.942206 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 3185
I20260809 06:31:53.943235 3270 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:54.042445 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 3185
2026-08-09T06:31:54Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3626 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:31:54 dist-test-slave-cvwc krb5kdc[3894](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:31:54 dist-test-slave-cvwc krb5kdc[3894](info): set up 2 sockets
Aug 09 06:31:54 dist-test-slave-cvwc krb5kdc[3894](info): commencing operation
krb5kdc: starting...
W20260809 06:31:55.232234 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.001s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:31:55 dist-test-slave-cvwc krb5kdc[3894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:31:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:31:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:31:55.421614 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:39041
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:39041
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:55.730394 3913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:55.730675 3913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:55.730816 3913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:55.737602 3913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:31:55.737725 3913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:55.737833 3913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:55.737914 3913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:31:55.737975 3913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:31:55.747148 3913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:39041
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:39041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:55.748281 3913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:55.749555 3913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:55.760293 3919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:55.760341 3918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:55.760340 3921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:55.761329 3913 server_base.cc:1034] running on GCE node
I20260809 06:31:55.762112 3913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:55.763391 3913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:55.764582 3913 hybrid_clock.cc:648] HybridClock initialized: now 1786257115764538 us; error 35 us; skew 500 ppm
I20260809 06:31:55.764904 3913 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:55 dist-test-slave-cvwc krb5kdc[3894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257115, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:55.771827 3913 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:31:55.773252 3913 webserver.cc:460] Webserver started at http://127.30.78.126:36615/ using document root <none> and password file <none>
I20260809 06:31:55.773940 3913 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:55.774049 3913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:55.774348 3913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:55.777166 3913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "6c5db563515440a385ab44cb2703a323"
format_stamp: "Formatted at 2026-08-09 06:31:55 on dist-test-slave-cvwc"
server_key: "76f8b42e3909de9e449bd81c3dcca1f9"
server_key_iv: "3cb542d6d3b5b2b34a7ce17ae716be13"
server_key_version: "encryptionkey@0"
I20260809 06:31:55.777949 3913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "6c5db563515440a385ab44cb2703a323"
format_stamp: "Formatted at 2026-08-09 06:31:55 on dist-test-slave-cvwc"
server_key: "76f8b42e3909de9e449bd81c3dcca1f9"
server_key_iv: "3cb542d6d3b5b2b34a7ce17ae716be13"
server_key_version: "encryptionkey@0"
I20260809 06:31:55.782622 3913 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 06:31:55.785794 3932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:55.786984 3913 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 06:31:55.787130 3913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "6c5db563515440a385ab44cb2703a323"
format_stamp: "Formatted at 2026-08-09 06:31:55 on dist-test-slave-cvwc"
server_key: "76f8b42e3909de9e449bd81c3dcca1f9"
server_key_iv: "3cb542d6d3b5b2b34a7ce17ae716be13"
server_key_version: "encryptionkey@0"
I20260809 06:31:55.787295 3913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:55.803351 3913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:55.806782 3913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:55.807013 3913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:55.823248 3913 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:39041
I20260809 06:31:55.823268 3999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:39041 every 8 connection(s)
I20260809 06:31:55.824455 3913 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:31:55.825963 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 3913
I20260809 06:31:55.826195 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:31:55.826987 31033 external_mini_cluster.cc:1428] Setting key 5cd29e041323f4b46eb1f23617e68bd3
I20260809 06:31:55.828711 4001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:31:55 dist-test-slave-cvwc krb5kdc[3894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:55.841665 4001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323: Bootstrap starting.
I20260809 06:31:55.844789 4001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:55.845997 4001 log.cc:824] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323: Log is configured to *not* fsync() on all Append() calls
I20260809 06:31:55.848496 4004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:55.828930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43368 (local address 127.30.78.126:39041)
0809 06:31:55.829644 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:55.829655 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:55.829694 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:31:55.831266 (+ 1572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:55.831285 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:55.831631 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:55.831947 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:55.833707 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:55.835058 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:55.836660 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:55.837271 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:55.837385 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:55.841947 (+ 4562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:55.841955 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:55.841968 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:55.842001 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:55.844743 (+ 2742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:55.845487 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:55.845493 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:55.845499 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:55.845654 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:55.846050 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:55.846053 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:55.846055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:55.846645 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:55.846956 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:55.847237 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 06:31:55.847609 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":322,"threads_started":1}
I20260809 06:31:55.848745 4001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323: No bootstrap required, opened a new log
I20260809 06:31:55.855737 4001 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5db563515440a385ab44cb2703a323" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39041 } }
I20260809 06:31:55.856061 4001 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:55.856158 4001 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5db563515440a385ab44cb2703a323, State: Initialized, Role: FOLLOWER
I20260809 06:31:55.856652 4001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5db563515440a385ab44cb2703a323" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39041 } }
I20260809 06:31:55.856858 4001 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:31:55.856999 4001 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:31:55.857154 4001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:55.859143 4001 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5db563515440a385ab44cb2703a323" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39041 } }
I20260809 06:31:55.859568 4001 leader_election.cc:302] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c5db563515440a385ab44cb2703a323; no voters:
I20260809 06:31:55.860064 4001 leader_election.cc:288] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:31:55.860159 4006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:55.861162 4006 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5db563515440a385ab44cb2703a323, State: Running, Role: LEADER
I20260809 06:31:55.861639 4006 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5db563515440a385ab44cb2703a323" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39041 } }
I20260809 06:31:55.861976 4001 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:31:55.864135 4008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c5db563515440a385ab44cb2703a323" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5db563515440a385ab44cb2703a323" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39041 } } }
I20260809 06:31:55.864470 4008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:55.865869 4018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:31:55.865862 4010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c5db563515440a385ab44cb2703a323. Latest consensus state: current_term: 1 leader_uuid: "6c5db563515440a385ab44cb2703a323" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c5db563515440a385ab44cb2703a323" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39041 } } }
I20260809 06:31:55.866165 4010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:55.870784 4018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:31:55.879707 4018 catalog_manager.cc:1347] Generated new cluster ID: e10ddebdae2144989fadb2d7af0678de
I20260809 06:31:55.879812 4018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:31:55.896587 4018 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:31:55.898312 4018 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:31:55.905148 4018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c5db563515440a385ab44cb2703a323: Generated new TSK 0
I20260809 06:31:55.905938 4018 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:31:55.965396 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39041
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:56.314920 4034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:56.315194 4034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:56.315338 4034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:56.322389 4034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:56.322501 4034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:56.322666 4034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:31:56.331982 4034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:56.333155 4034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:56.334445 4034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:56.346901 4043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:56.346946 4040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:56.346977 4039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:56.347872 4034 server_base.cc:1034] running on GCE node
I20260809 06:31:56.348507 4034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:56.349406 4034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:56.350610 4034 hybrid_clock.cc:648] HybridClock initialized: now 1786257116350556 us; error 41 us; skew 500 ppm
I20260809 06:31:56.350903 4034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:56 dist-test-slave-cvwc krb5kdc[3894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257116, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:56.353816 4034 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:31:56.355072 4034 webserver.cc:460] Webserver started at http://127.30.78.65:33115/ using document root <none> and password file <none>
I20260809 06:31:56.355698 4034 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:56.355808 4034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:56.356083 4034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:56.358834 4034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "e1bb0bdc1ba54f67a173039cb389d322"
format_stamp: "Formatted at 2026-08-09 06:31:56 on dist-test-slave-cvwc"
server_key: "f56b33ddd9ca4391d3b179117bdd116e"
server_key_iv: "33bbbc9bcf5b6927ef5e5dbdb6b981e0"
server_key_version: "encryptionkey@0"
I20260809 06:31:56.359583 4034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "e1bb0bdc1ba54f67a173039cb389d322"
format_stamp: "Formatted at 2026-08-09 06:31:56 on dist-test-slave-cvwc"
server_key: "f56b33ddd9ca4391d3b179117bdd116e"
server_key_iv: "33bbbc9bcf5b6927ef5e5dbdb6b981e0"
server_key_version: "encryptionkey@0"
I20260809 06:31:56.364302 4034 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260809 06:31:56.367667 4051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:56.368816 4034 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:31:56.368957 4034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "e1bb0bdc1ba54f67a173039cb389d322"
format_stamp: "Formatted at 2026-08-09 06:31:56 on dist-test-slave-cvwc"
server_key: "f56b33ddd9ca4391d3b179117bdd116e"
server_key_iv: "33bbbc9bcf5b6927ef5e5dbdb6b981e0"
server_key_version: "encryptionkey@0"
I20260809 06:31:56.369119 4034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:56.386044 4034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:56.389407 4034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:56.389642 4034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:56.390551 4034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:56.391796 4034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:56.391866 4034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:56.391978 4034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:56.392026 4034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:56.421243 4034 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:45433
I20260809 06:31:56.421288 4227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:45433 every 8 connection(s)
I20260809 06:31:56.422439 4034 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:31:56.424095 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 4034
I20260809 06:31:56.424314 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:31:56.424983 31033 external_mini_cluster.cc:1428] Setting key df4119f7f3e069bbf99b533b51f73b44
Aug 09 06:31:56 dist-test-slave-cvwc krb5kdc[3894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257116, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:56.441052 4231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:56.424905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:34953 (local address 127.30.78.126:39041)
0809 06:31:56.425408 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:56.425414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:56.426373 (+ 959us) server_negotiation.cc:407] Connection header received
0809 06:31:56.428120 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:56.428125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:56.428199 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:56.428291 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:56.429733 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:56.430440 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:56.431920 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:56.432312 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:56.432432 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:56.435790 (+ 3358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:56.435795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:56.435799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:56.435829 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:56.438254 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:56.438926 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:56.438930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:56.438932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:56.439044 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:56.439436 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:56.439442 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:56.439445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:56.439694 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:56.439822 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:56.440470 (+ 648us) server_negotiation.cc:299] Negotiation successful
0809 06:31:56.440689 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":257,"threads_started":1}
I20260809 06:31:56.441939 4233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:56.425415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:39041 (local address 127.30.78.65:34953)
0809 06:31:56.426194 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:56.426248 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:56.427862 (+ 1614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:56.428532 (+ 670us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:56.428540 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:56.429035 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:56.429548 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:56.429567 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:56.430598 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:56.430602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:56.431781 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:56.431794 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:56.432530 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:56.432537 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:56.432754 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:56.433375 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:56.433403 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:56.435593 (+ 2190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:56.438389 (+ 2796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:56.438397 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:56.438412 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:56.438805 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:56.439148 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:56.439152 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:56.439156 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:56.439331 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:56.439814 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:56.439821 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:56.440118 (+ 297us) client_negotiation.cc:769] Sending connection context
0809 06:31:56.440349 (+ 231us) client_negotiation.cc:240] Negotiation successful
0809 06:31:56.440821 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":318,"threads_started":1}
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
I20260809 06:31:56.443394 4228 heartbeater.cc:347] Connected to a master server at 127.30.78.126:39041
I20260809 06:31:56.443662 4228 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:56.444334 4228 heartbeater.cc:511] Master 127.30.78.126:39041 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
I20260809 06:31:56.446437 3959 ts_manager.cc:194] Registered new tserver with Master: e1bb0bdc1ba54f67a173039cb389d322 (127.30.78.65:45433)
I20260809 06:31:56.447814 3959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:34953
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:31:56.465704 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39041
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:56.775622 4239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:56.775887 4239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:56.776016 4239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:56.782956 4239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:56.783064 4239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:56.783217 4239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:31:56.792515 4239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:56.793681 4239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:56.794973 4239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:56.807055 4249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:56.807256 4247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:56.807668 4239 server_base.cc:1034] running on GCE node
W20260809 06:31:56.807755 4255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:56.808421 4239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:56.809274 4239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:56.810468 4239 hybrid_clock.cc:648] HybridClock initialized: now 1786257116810413 us; error 45 us; skew 500 ppm
I20260809 06:31:56.810748 4239 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:56 dist-test-slave-cvwc krb5kdc[3894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257116, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:56.813591 4239 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:31:56.814877 4239 webserver.cc:460] Webserver started at http://127.30.78.66:36963/ using document root <none> and password file <none>
I20260809 06:31:56.815474 4239 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:56.815579 4239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:56.815863 4239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:56.818702 4239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "e0de1b202ede4f64941c296defbbb207"
format_stamp: "Formatted at 2026-08-09 06:31:56 on dist-test-slave-cvwc"
server_key: "31e6c318935ffc8bb0e0a1ad12499b7a"
server_key_iv: "0234e06e5801e7cc02bccf817611eac8"
server_key_version: "encryptionkey@0"
I20260809 06:31:56.819427 4239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "e0de1b202ede4f64941c296defbbb207"
format_stamp: "Formatted at 2026-08-09 06:31:56 on dist-test-slave-cvwc"
server_key: "31e6c318935ffc8bb0e0a1ad12499b7a"
server_key_iv: "0234e06e5801e7cc02bccf817611eac8"
server_key_version: "encryptionkey@0"
I20260809 06:31:56.824281 4239 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 06:31:56.827579 4268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:56.828817 4239 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:31:56.828965 4239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "e0de1b202ede4f64941c296defbbb207"
format_stamp: "Formatted at 2026-08-09 06:31:56 on dist-test-slave-cvwc"
server_key: "31e6c318935ffc8bb0e0a1ad12499b7a"
server_key_iv: "0234e06e5801e7cc02bccf817611eac8"
server_key_version: "encryptionkey@0"
I20260809 06:31:56.829128 4239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:56.848850 4239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:56.854384 4239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:56.854656 4239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:56.855507 4239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:56.856745 4239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:56.856827 4239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:56.856945 4239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:56.856993 4239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:56.884594 4239 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:43675
I20260809 06:31:56.884634 4430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:43675 every 8 connection(s)
I20260809 06:31:56.885844 4239 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:31:56.889986 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 4239
I20260809 06:31:56.890162 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:31:56.890638 31033 external_mini_cluster.cc:1428] Setting key 1bcce932b975d6a19aca8b873863b150
Aug 09 06:31:56 dist-test-slave-cvwc krb5kdc[3894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257116, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:56.906112 4231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:56.888246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:58967 (local address 127.30.78.126:39041)
0809 06:31:56.888416 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:56.888421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:56.889456 (+ 1035us) server_negotiation.cc:407] Connection header received
0809 06:31:56.891338 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:56.891344 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:56.891435 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:56.891544 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:56.893341 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:56.894119 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:56.896102 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:56.896526 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:56.896613 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:56.900559 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:56.900564 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:56.900568 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:56.900602 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:56.903135 (+ 2533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:56.903955 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:56.903958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:56.903960 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:56.904080 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:56.904512 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:56.904515 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:56.904517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:56.904767 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:56.904897 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:56.905673 (+ 776us) server_negotiation.cc:299] Negotiation successful
0809 06:31:56.905881 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:31:56.907472 4434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:56.888628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:39041 (local address 127.30.78.66:58967)
0809 06:31:56.889303 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:56.889341 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:56.891076 (+ 1735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:56.891790 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:56.891798 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:56.892393 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:56.893147 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:56.893173 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:56.894276 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:56.894281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:56.895973 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:56.895988 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:56.896731 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:56.896738 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:56.897001 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:56.897672 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:56.897706 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:56.900314 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:56.903270 (+ 2956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:56.903278 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:56.903293 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:56.903852 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:56.904178 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:56.904182 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:56.904186 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:56.904419 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:56.904886 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:56.904894 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:56.905300 (+ 406us) client_negotiation.cc:769] Sending connection context
0809 06:31:56.905601 (+ 301us) client_negotiation.cc:240] Negotiation successful
0809 06:31:56.906119 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":263,"threads_started":1}
I20260809 06:31:56.908798 4431 heartbeater.cc:347] Connected to a master server at 127.30.78.126:39041
I20260809 06:31:56.909121 4431 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:56.910028 4431 heartbeater.cc:511] Master 127.30.78.126:39041 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
I20260809 06:31:56.911535 3959 ts_manager.cc:194] Registered new tserver with Master: e0de1b202ede4f64941c296defbbb207 (127.30.78.66:43675)
I20260809 06:31:56.912276 3959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:58967
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:31:56.934890 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39041
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:57.247855 4439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:57.248124 4439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:57.248260 4439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:57.255410 4439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:57.255523 4439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:57.255676 4439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:31:57.265290 4439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:57.266553 4439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:57.267832 4439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:57.280112 4449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:57.280180 4444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:57.280205 4445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:57.280652 4439 server_base.cc:1034] running on GCE node
I20260809 06:31:57.281276 4439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:57.282174 4439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:57.283365 4439 hybrid_clock.cc:648] HybridClock initialized: now 1786257117283314 us; error 44 us; skew 500 ppm
I20260809 06:31:57.283664 4439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[3894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257117, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:57.286722 4439 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:31:57.288065 4439 webserver.cc:460] Webserver started at http://127.30.78.67:39985/ using document root <none> and password file <none>
I20260809 06:31:57.288698 4439 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:57.288801 4439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:57.289079 4439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:57.291913 4439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "f8f60e351b6946de933eefaec6d08bad"
format_stamp: "Formatted at 2026-08-09 06:31:57 on dist-test-slave-cvwc"
server_key: "9d7bf38371606a408ebcc45a4f961741"
server_key_iv: "23204b9ad691422c888ff44eb342093c"
server_key_version: "encryptionkey@0"
I20260809 06:31:57.292641 4439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "f8f60e351b6946de933eefaec6d08bad"
format_stamp: "Formatted at 2026-08-09 06:31:57 on dist-test-slave-cvwc"
server_key: "9d7bf38371606a408ebcc45a4f961741"
server_key_iv: "23204b9ad691422c888ff44eb342093c"
server_key_version: "encryptionkey@0"
I20260809 06:31:57.297470 4439 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260809 06:31:57.300745 4456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:57.302037 4439 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:31:57.302170 4439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "f8f60e351b6946de933eefaec6d08bad"
format_stamp: "Formatted at 2026-08-09 06:31:57 on dist-test-slave-cvwc"
server_key: "9d7bf38371606a408ebcc45a4f961741"
server_key_iv: "23204b9ad691422c888ff44eb342093c"
server_key_version: "encryptionkey@0"
I20260809 06:31:57.302340 4439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:57.323894 4439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:57.327913 4439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:57.328143 4439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:57.329010 4439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:31:57.330274 4439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:31:57.330349 4439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:57.330440 4439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:31:57.330482 4439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:57.360395 4439 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:39885
I20260809 06:31:57.360433 4620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:39885 every 8 connection(s)
I20260809 06:31:57.361629 4439 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:31:57.369740 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 4439
I20260809 06:31:57.369959 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:31:57.370494 31033 external_mini_cluster.cc:1428] Setting key b751d9a95b4a406aa496ee7065bc3d6b
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[3894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257117, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:57.380512 4231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:57.364061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:33443 (local address 127.30.78.126:39041)
0809 06:31:57.364254 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:57.364260 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:57.365413 (+ 1153us) server_negotiation.cc:407] Connection header received
0809 06:31:57.367203 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:57.367208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:57.367302 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:57.367391 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:57.368792 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.369626 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.371579 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.372107 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.372236 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:57.375790 (+ 3554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:57.375795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:57.375798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:57.375828 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:57.378174 (+ 2346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.378790 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.378793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.378795 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.378912 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.379228 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.379230 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.379232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.379467 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:57.379570 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:57.380126 (+ 556us) server_negotiation.cc:299] Negotiation successful
0809 06:31:57.380280 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:31:57.381374 4631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:57.364568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:39041 (local address 127.30.78.67:33443)
0809 06:31:57.365255 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0809 06:31:57.365302 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:31:57.366973 (+ 1671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:31:57.367579 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:31:57.367586 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:31:57.368108 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:31:57.368662 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:57.368680 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.369800 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.369805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:57.371458 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:31:57.371471 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.372330 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.372338 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:31:57.372591 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:57.373275 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:31:57.373297 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:31:57.375608 (+ 2311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:31:57.378281 (+ 2673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:57.378287 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:57.378298 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:57.378700 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:57.378984 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:31:57.378987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:31:57.378990 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:31:57.379150 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:31:57.379552 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:31:57.379558 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:31:57.379827 (+ 269us) client_negotiation.cc:769] Sending connection context
0809 06:31:57.380043 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 06:31:57.380388 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":266,"threads_started":1}
I20260809 06:31:57.382576 4621 heartbeater.cc:347] Connected to a master server at 127.30.78.126:39041
I20260809 06:31:57.382851 4621 heartbeater.cc:464] Registering TS with master...
I20260809 06:31:57.383502 4621 heartbeater.cc:511] Master 127.30.78.126:39041 requested a full tablet report, sending...
I20260809 06:31:57.384939 3959 ts_manager.cc:194] Registered new tserver with Master: f8f60e351b6946de933eefaec6d08bad (127.30.78.67:39885)
I20260809 06:31:57.385924 3959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:33443
I20260809 06:31:57.386664 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[3894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[3894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:31:57.431639 4638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:57.418054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40138 (local address 127.30.78.65:45433)
0809 06:31:57.418558 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:57.418565 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:57.418593 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:31:57.418747 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:57.418753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:57.418954 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:57.419074 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:57.420383 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.421420 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.422679 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.423224 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.423354 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:57.427029 (+ 3675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:57.427039 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:57.427050 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:57.427078 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:57.429442 (+ 2364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.430055 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.430061 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.430064 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.430177 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.430442 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.430445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.430447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.430738 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:57.430945 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:57.431118 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 06:31:57.431291 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":231,"threads_started":1}
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[3894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:57.447022 4231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:57.435356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43376 (local address 127.30.78.126:39041)
0809 06:31:57.435578 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:57.435584 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:57.435700 (+ 116us) server_negotiation.cc:407] Connection header received
0809 06:31:57.435815 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:57.435818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:57.435901 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:57.435978 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:57.437057 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.437963 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.439097 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.439497 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.439586 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:57.442840 (+ 3254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:57.442845 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:57.442848 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:57.442881 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:57.445035 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.445558 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.445561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.445563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.445675 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.445989 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.445992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.445994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.446305 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:57.446497 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:57.446662 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 06:31:57.446817 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260809 06:31:57.447521 3959 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43376
I20260809 06:31:57.448366 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 4034
I20260809 06:31:57.450425 4228 heartbeater.cc:503] Master 127.30.78.126:39041 was elected leader, sending a full tablet report...
I20260809 06:31:57.459407 4638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:57.449287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40154 (local address 127.30.78.65:45433)
0809 06:31:57.449471 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:57.449476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:57.449572 (+ 96us) server_negotiation.cc:407] Connection header received
0809 06:31:57.449746 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:57.449752 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:57.449814 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:57.449889 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:57.451040 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.451753 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.452916 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.453307 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.453398 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:57.455296 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:57.455300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:57.455303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:57.455332 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:57.457502 (+ 2170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.458073 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.458076 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.458078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.458183 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.458438 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.458441 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.458443 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.458670 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:57.458830 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:57.459043 (+ 213us) server_negotiation.cc:299] Negotiation successful
0809 06:31:57.459194 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:31:57.459946 4222 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:57.540463 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 4034
I20260809 06:31:57.558773 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 4239
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[3894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:31:57.574111 4652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:57.559612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47880 (local address 127.30.78.66:43675)
0809 06:31:57.560145 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:57.560152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:57.560176 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:31:57.560242 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:57.560248 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:57.560462 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:57.560609 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:57.562021 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.563025 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.564245 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.564784 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.564901 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:57.568797 (+ 3896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:57.568807 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:57.568820 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:57.568858 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:57.571460 (+ 2602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.572072 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.572079 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.572081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.572200 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.572542 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.572546 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.572548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.572873 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:57.573162 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:57.573470 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 06:31:57.573773 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":274,"threads_started":1}
I20260809 06:31:57.575301 4425 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:57.655218 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 4239
I20260809 06:31:57.673707 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 4439
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[3894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:31:57.688947 4654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:57.674632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42666 (local address 127.30.78.67:39885)
0809 06:31:57.675211 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:57.675217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:57.675250 (+ 33us) server_negotiation.cc:407] Connection header received
0809 06:31:57.675319 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:57.675325 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:57.675536 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:57.675689 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:57.676979 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.678050 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.679364 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:57.679906 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:57.680020 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:57.684010 (+ 3990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:57.684021 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:57.684034 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:57.684067 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:57.686738 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.687289 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.687295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.687297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.687414 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:57.687672 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:57.687674 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:57.687676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:57.688008 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:57.688222 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:57.688426 (+ 204us) server_negotiation.cc:299] Negotiation successful
0809 06:31:57.688646 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":272,"threads_started":1}
I20260809 06:31:57.690340 4611 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:57.772045 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 4439
I20260809 06:31:57.792055 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 3913
I20260809 06:31:57.793187 3995 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:31:57.892565 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 3913
2026-08-09T06:31:57Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3851 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[4663](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[4663](info): set up 2 sockets
Aug 09 06:31:57 dist-test-slave-cvwc krb5kdc[4663](info): commencing operation
krb5kdc: starting...
W20260809 06:31:59.084905 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.148s user 0.000s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:31:59 dist-test-slave-cvwc krb5kdc[4663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:31:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:31:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:31:59.266824 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33823
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:35437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:33823
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:31:59.574551 4686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:31:59.574821 4686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:31:59.574919 4686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:31:59.581804 4686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:31:59.581892 4686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:31:59.581943 4686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:31:59.581995 4686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:31:59.582041 4686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:31:59.591300 4686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:35437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:33823
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33823
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:31:59.592643 4686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:31:59.593972 4686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:31:59.604765 4696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:59.604789 4697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:31:59.604830 4699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:31:59.605695 4686 server_base.cc:1034] running on GCE node
I20260809 06:31:59.606488 4686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:31:59.607764 4686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:31:59.608968 4686 hybrid_clock.cc:648] HybridClock initialized: now 1786257119608917 us; error 43 us; skew 500 ppm
I20260809 06:31:59.609289 4686 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:31:59 dist-test-slave-cvwc krb5kdc[4663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257119, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:31:59.612177 4686 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:31:59.613270 4686 fs_manager.cc:359] Metadata directory not provided
I20260809 06:31:59.613359 4686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:31:59.613618 4686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:31:59.616437 4686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "8997b90fcdda497fa84ee73d666be2b1"
format_stamp: "Formatted at 2026-08-09 06:31:59 on dist-test-slave-cvwc"
server_key: "1710b5c48dad9830be6ffc35bc173afc"
server_key_iv: "daa5f8837e395010dfc8879a30cdc22d"
server_key_version: "encryptionkey@0"
I20260809 06:31:59.617170 4686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "8997b90fcdda497fa84ee73d666be2b1"
format_stamp: "Formatted at 2026-08-09 06:31:59 on dist-test-slave-cvwc"
server_key: "1710b5c48dad9830be6ffc35bc173afc"
server_key_iv: "daa5f8837e395010dfc8879a30cdc22d"
server_key_version: "encryptionkey@0"
I20260809 06:31:59.622040 4686 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:31:59.625200 4708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:31:59.626422 4686 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:31:59.626562 4686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "8997b90fcdda497fa84ee73d666be2b1"
format_stamp: "Formatted at 2026-08-09 06:31:59 on dist-test-slave-cvwc"
server_key: "1710b5c48dad9830be6ffc35bc173afc"
server_key_iv: "daa5f8837e395010dfc8879a30cdc22d"
server_key_version: "encryptionkey@0"
I20260809 06:31:59.626741 4686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:31:59.646082 4686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:31:59.649519 4686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:31:59.649755 4686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:31:59.665948 4686 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:33823
I20260809 06:31:59.665926 4784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:33823 every 8 connection(s)
I20260809 06:31:59.666754 4686 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:31:59.670105 4785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:31:59.672824 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 4686
I20260809 06:31:59.673015 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:31:59.673614 31033 external_mini_cluster.cc:1428] Setting key 3d3a9feea787b21a9445d61f963d10d6
I20260809 06:31:59.681607 4785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1: Bootstrap starting.
I20260809 06:31:59.685117 4785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1: Neither blocks nor log segments found. Creating new log.
I20260809 06:31:59.686364 4785 log.cc:824] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:31:59 dist-test-slave-cvwc krb5kdc[4663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:31:59.689201 4785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1: No bootstrap required, opened a new log
I20260809 06:31:59.695294 4789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:31:59.675469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42748 (local address 127.30.78.126:33823)
0809 06:31:59.676212 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0809 06:31:59.676223 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:31:59.676262 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:31:59.677862 (+ 1600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:31:59.677890 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:31:59.678244 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:31:59.678565 (+ 321us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:31:59.680312 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:59.681510 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:59.683241 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:31:59.683865 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:31:59.683994 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:31:59.688672 (+ 4678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:31:59.688680 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:31:59.688693 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:31:59.688730 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:31:59.691590 (+ 2860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:59.692334 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:59.692340 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:59.692346 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:59.692498 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:31:59.692859 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:31:59.692862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:31:59.692864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:31:59.693382 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:31:59.693603 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 06:31:59.694011 (+ 408us) server_negotiation.cc:299] Negotiation successful
0809 06:31:59.694317 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":339,"threads_started":1}
I20260809 06:31:59.697614 4785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8997b90fcdda497fa84ee73d666be2b1" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33823 } }
I20260809 06:31:59.698071 4785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:31:59.698184 4785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8997b90fcdda497fa84ee73d666be2b1, State: Initialized, Role: FOLLOWER
I20260809 06:31:59.698704 4785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8997b90fcdda497fa84ee73d666be2b1" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33823 } }
I20260809 06:31:59.698904 4785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:31:59.699023 4785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:31:59.699165 4785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:31:59.701130 4785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8997b90fcdda497fa84ee73d666be2b1" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33823 } }
I20260809 06:31:59.701589 4785 leader_election.cc:302] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8997b90fcdda497fa84ee73d666be2b1; no voters:
I20260809 06:31:59.702144 4785 leader_election.cc:288] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:31:59.702248 4792 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:31:59.702814 4792 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [term 1 LEADER]: Becoming Leader. State: Replica: 8997b90fcdda497fa84ee73d666be2b1, State: Running, Role: LEADER
I20260809 06:31:59.703397 4792 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8997b90fcdda497fa84ee73d666be2b1" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33823 } }
I20260809 06:31:59.704433 4785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:31:59.705971 4797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8997b90fcdda497fa84ee73d666be2b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8997b90fcdda497fa84ee73d666be2b1" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33823 } } }
I20260809 06:31:59.706002 4795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8997b90fcdda497fa84ee73d666be2b1. Latest consensus state: current_term: 1 leader_uuid: "8997b90fcdda497fa84ee73d666be2b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8997b90fcdda497fa84ee73d666be2b1" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33823 } } }
I20260809 06:31:59.706344 4797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:59.706342 4795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1 [sys.catalog]: This master's current role is: LEADER
I20260809 06:31:59.707823 4806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:31:59.712684 4806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:31:59.721316 4806 catalog_manager.cc:1347] Generated new cluster ID: 03b37432a462450b93e3a4d3cb8641a1
I20260809 06:31:59.721421 4806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:31:59.737504 4806 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:31:59.738734 4806 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:31:59.747920 4806 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1: Generated new TSK 0
I20260809 06:31:59.748903 4806 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:31:59.805434 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33823
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:35437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:00.119887 4826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:00.120137 4826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:00.120270 4826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:00.127453 4826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:00.127552 4826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:00.127691 4826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:00.138217 4826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:35437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:00.139542 4826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:00.140767 4826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:00.152451 4840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:00.152493 4836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:00.152534 4835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:00.153546 4826 server_base.cc:1034] running on GCE node
I20260809 06:32:00.154114 4826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:00.154908 4826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:00.156104 4826 hybrid_clock.cc:648] HybridClock initialized: now 1786257120156056 us; error 39 us; skew 500 ppm
I20260809 06:32:00.156404 4826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:00 dist-test-slave-cvwc krb5kdc[4663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:00.159320 4826 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:32:00.160357 4826 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:00.160465 4826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:00.160760 4826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:00.163518 4826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "304aac355dfa4395be1b840e17020f9a"
format_stamp: "Formatted at 2026-08-09 06:32:00 on dist-test-slave-cvwc"
server_key: "dece5a64e037f07c58855a8880d531c7"
server_key_iv: "acddf90c79bfb46fa0b90f2250b7ec75"
server_key_version: "encryptionkey@0"
I20260809 06:32:00.164276 4826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "304aac355dfa4395be1b840e17020f9a"
format_stamp: "Formatted at 2026-08-09 06:32:00 on dist-test-slave-cvwc"
server_key: "dece5a64e037f07c58855a8880d531c7"
server_key_iv: "acddf90c79bfb46fa0b90f2250b7ec75"
server_key_version: "encryptionkey@0"
I20260809 06:32:00.168828 4826 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:32:00.171926 4846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:00.173055 4826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:32:00.173193 4826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "304aac355dfa4395be1b840e17020f9a"
format_stamp: "Formatted at 2026-08-09 06:32:00 on dist-test-slave-cvwc"
server_key: "dece5a64e037f07c58855a8880d531c7"
server_key_iv: "acddf90c79bfb46fa0b90f2250b7ec75"
server_key_version: "encryptionkey@0"
I20260809 06:32:00.173375 4826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:00.199508 4826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:00.203151 4826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:00.203387 4826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:00.204289 4826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:00.205621 4826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:00.205735 4826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:00.205847 4826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:00.205924 4826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:00.235528 4826 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:36205
I20260809 06:32:00.235602 5009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:36205 every 8 connection(s)
I20260809 06:32:00.236361 4826 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:00.242995 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 4826
I20260809 06:32:00.243188 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:32:00.243780 31033 external_mini_cluster.cc:1428] Setting key f4e4704eca1dda5672af70a2aaff1bed
Aug 09 06:32:00 dist-test-slave-cvwc krb5kdc[4663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:00.255636 5016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:00.238648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:37679 (local address 127.30.78.126:33823)
0809 06:32:00.239083 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:00.239088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:00.239874 (+ 786us) server_negotiation.cc:407] Connection header received
0809 06:32:00.241647 (+ 1773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:00.241653 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:00.241765 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:00.241866 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:00.243410 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:00.244173 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:00.245929 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:00.246305 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:00.246423 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:00.249979 (+ 3556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:00.249984 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:00.249987 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:00.250019 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:00.252691 (+ 2672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:00.253357 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:00.253363 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:00.253366 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:00.253521 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:00.253949 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:00.253955 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:00.253959 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:00.254298 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:00.254451 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:00.255039 (+ 588us) server_negotiation.cc:299] Negotiation successful
0809 06:32:00.255273 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":233,"threads_started":1}
I20260809 06:32:00.256386 5019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:00.239070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33823 (local address 127.30.78.65:37679)
0809 06:32:00.239726 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:00.239764 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:00.241376 (+ 1612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:00.242124 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:00.242131 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:00.242628 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:00.243221 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:00.243248 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:00.244321 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:00.244325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:00.245798 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:00.245811 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:00.246522 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:00.246530 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:00.246750 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:00.247363 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:00.247391 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:00.249766 (+ 2375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:00.252816 (+ 3050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:00.252823 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:00.252833 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:00.253243 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:00.253635 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:00.253639 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:00.253641 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:00.253853 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:00.254406 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:00.254411 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:00.254696 (+ 285us) client_negotiation.cc:769] Sending connection context
0809 06:32:00.254920 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 06:32:00.255282 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":266,"threads_started":1}
I20260809 06:32:00.257901 5012 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33823
I20260809 06:32:00.258164 5012 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:00.258767 5012 heartbeater.cc:511] Master 127.30.78.126:33823 requested a full tablet report, sending...
I20260809 06:32:00.260701 4736 ts_manager.cc:194] Registered new tserver with Master: 304aac355dfa4395be1b840e17020f9a (127.30.78.65:36205)
I20260809 06:32:00.262121 4736 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:37679
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:32:00.286280 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33823
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:35437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:00.590371 5026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:00.590628 5026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:00.590770 5026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:00.597543 5026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:00.597652 5026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:00.597836 5026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:00.607127 5026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:35437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:00.608301 5026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:00.609553 5026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:00.621623 5031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:00.621595 5033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:00.621660 5035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:00.622236 5026 server_base.cc:1034] running on GCE node
I20260809 06:32:00.622818 5026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:00.623674 5026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:00.624864 5026 hybrid_clock.cc:648] HybridClock initialized: now 1786257120624816 us; error 40 us; skew 500 ppm
I20260809 06:32:00.625157 5026 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:00 dist-test-slave-cvwc krb5kdc[4663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:00.628091 5026 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:32:00.629204 5026 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:00.629311 5026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:00.629611 5026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:00.632580 5026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "3ac9e949a54a43ac85ffab28b330d915"
format_stamp: "Formatted at 2026-08-09 06:32:00 on dist-test-slave-cvwc"
server_key: "ea70dabf289aee569135543ac8420908"
server_key_iv: "acb10f1d7c890c0460248e2e865ef4f6"
server_key_version: "encryptionkey@0"
I20260809 06:32:00.633339 5026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "3ac9e949a54a43ac85ffab28b330d915"
format_stamp: "Formatted at 2026-08-09 06:32:00 on dist-test-slave-cvwc"
server_key: "ea70dabf289aee569135543ac8420908"
server_key_iv: "acb10f1d7c890c0460248e2e865ef4f6"
server_key_version: "encryptionkey@0"
I20260809 06:32:00.638044 5026 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.008s sys 0.000s
I20260809 06:32:00.641212 5044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:00.642446 5026 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:32:00.642585 5026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "3ac9e949a54a43ac85ffab28b330d915"
format_stamp: "Formatted at 2026-08-09 06:32:00 on dist-test-slave-cvwc"
server_key: "ea70dabf289aee569135543ac8420908"
server_key_iv: "acb10f1d7c890c0460248e2e865ef4f6"
server_key_version: "encryptionkey@0"
I20260809 06:32:00.642767 5026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:00.665688 5026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:00.669545 5026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:00.669831 5026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:00.670698 5026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:00.672039 5026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:00.672134 5026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:00.672235 5026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:00.672307 5026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:00.702178 5026 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:41147
I20260809 06:32:00.702248 5220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:41147 every 8 connection(s)
I20260809 06:32:00.702989 5026 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:00.710337 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 5026
I20260809 06:32:00.710552 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:32:00.711133 31033 external_mini_cluster.cc:1428] Setting key c05af09502b0c47cbb1f7e10e2682322
Aug 09 06:32:00 dist-test-slave-cvwc krb5kdc[4663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257120, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:00.722138 5016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:00.705329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:33609 (local address 127.30.78.126:33823)
0809 06:32:00.705499 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:00.705503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:00.706574 (+ 1071us) server_negotiation.cc:407] Connection header received
0809 06:32:00.708267 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:00.708272 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:00.708341 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:00.708428 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:00.709839 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:00.710929 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:00.712604 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:00.713017 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:00.713128 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:00.716699 (+ 3571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:00.716704 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:00.716708 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:00.716738 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:00.719108 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:00.719922 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:00.719927 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:00.719930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:00.720087 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:00.720452 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:00.720456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:00.720459 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:00.720779 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:00.720937 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:00.721551 (+ 614us) server_negotiation.cc:299] Negotiation successful
0809 06:32:00.721795 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 06:32:00.722820 5223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:00.705733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33823 (local address 127.30.78.66:33609)
0809 06:32:00.706415 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:00.706462 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:00.708034 (+ 1572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:00.708606 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:00.708613 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:00.709088 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:00.709683 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:00.709701 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:00.711094 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:00.711099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:00.712467 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:00.712479 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:00.713225 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:00.713232 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:00.713442 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:00.714067 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:00.714088 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:00.716488 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:00.719248 (+ 2760us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:00.719257 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:00.719272 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:00.719801 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:00.720183 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:00.720186 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:00.720188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:00.720353 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:00.720882 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:00.720887 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:00.721197 (+ 310us) client_negotiation.cc:769] Sending connection context
0809 06:32:00.721407 (+ 210us) client_negotiation.cc:240] Negotiation successful
0809 06:32:00.721803 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":266,"threads_started":1}
I20260809 06:32:00.724159 5221 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33823
I20260809 06:32:00.724414 5221 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:00.724998 5221 heartbeater.cc:511] Master 127.30.78.126:33823 requested a full tablet report, sending...
I20260809 06:32:00.726377 4736 ts_manager.cc:194] Registered new tserver with Master: 3ac9e949a54a43ac85ffab28b330d915 (127.30.78.66:41147)
I20260809 06:32:00.727202 4736 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:33609
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:32:00.754065 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33823
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:35437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:01.084400 5228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:01.084672 5228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:01.084829 5228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:01.091934 5228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:01.092051 5228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:01.092222 5228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:01.101680 5228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:35437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33823
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:01.102893 5228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:01.104212 5228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:01.116220 5235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:01.116422 5236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:01.116442 5241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:01.117213 5228 server_base.cc:1034] running on GCE node
I20260809 06:32:01.117815 5228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:01.118708 5228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:01.119892 5228 hybrid_clock.cc:648] HybridClock initialized: now 1786257121119836 us; error 44 us; skew 500 ppm
I20260809 06:32:01.120167 5228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:01 dist-test-slave-cvwc krb5kdc[4663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257121, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:01.126643 5228 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:32:01.127722 5228 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:01.127823 5228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:01.128124 5228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:01.130931 5228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "369a5340e5bd4b78b33216792d4e45a7"
format_stamp: "Formatted at 2026-08-09 06:32:01 on dist-test-slave-cvwc"
server_key: "83ae16c9d16b8e27f08843b4a2c18742"
server_key_iv: "8bfda918aab513ff8bbdc18ed1070e83"
server_key_version: "encryptionkey@0"
I20260809 06:32:01.131692 5228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "369a5340e5bd4b78b33216792d4e45a7"
format_stamp: "Formatted at 2026-08-09 06:32:01 on dist-test-slave-cvwc"
server_key: "83ae16c9d16b8e27f08843b4a2c18742"
server_key_iv: "8bfda918aab513ff8bbdc18ed1070e83"
server_key_version: "encryptionkey@0"
I20260809 06:32:01.136303 5228 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:32:01.139775 5250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:01.141299 5228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:32:01.141494 5228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "369a5340e5bd4b78b33216792d4e45a7"
format_stamp: "Formatted at 2026-08-09 06:32:01 on dist-test-slave-cvwc"
server_key: "83ae16c9d16b8e27f08843b4a2c18742"
server_key_iv: "8bfda918aab513ff8bbdc18ed1070e83"
server_key_version: "encryptionkey@0"
I20260809 06:32:01.141791 5228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:01.159843 5228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:01.163349 5228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:01.163575 5228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:01.164472 5228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:01.165755 5228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:01.165850 5228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:01.165964 5228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:01.166039 5228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:01.196143 5228 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:35677
I20260809 06:32:01.196204 5404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:35677 every 8 connection(s)
I20260809 06:32:01.196904 5228 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:01.199836 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 5228
I20260809 06:32:01.200052 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:32:01.200627 31033 external_mini_cluster.cc:1428] Setting key a9843ce3fb41a40ddaa2699e88ebad68
Aug 09 06:32:01 dist-test-slave-cvwc krb5kdc[4663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257121, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:01.215734 5016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.199165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:36665 (local address 127.30.78.126:33823)
0809 06:32:01.199341 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.199345 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.200542 (+ 1197us) server_negotiation.cc:407] Connection header received
0809 06:32:01.202820 (+ 2278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.202826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.202947 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.203055 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:01.204569 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.205318 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.206805 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.207208 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.207310 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.210343 (+ 3033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:01.210348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:01.210351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:01.210383 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:01.212857 (+ 2474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.213462 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.213465 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.213468 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.213581 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.213950 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.213953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.213955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.214257 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:01.214387 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.215170 (+ 783us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.215359 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:32:01.216540 5410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.199561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33823 (local address 127.30.78.67:36665)
0809 06:32:01.200358 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:01.200414 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:01.202537 (+ 2123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:01.203216 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:01.203223 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:01.203832 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:01.204425 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.204443 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.205441 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.205445 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.206694 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.206707 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.207374 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.207379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.207549 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.208098 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:01.208119 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:01.210164 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:01.212971 (+ 2807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:01.212977 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:01.212988 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:01.213369 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:01.213653 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:01.213656 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:01.213658 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:01.213854 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:01.214401 (+ 547us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:01.214408 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:01.214756 (+ 348us) client_negotiation.cc:769] Sending connection context
0809 06:32:01.215057 (+ 301us) client_negotiation.cc:240] Negotiation successful
0809 06:32:01.215489 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":327,"threads_started":1}
I20260809 06:32:01.217790 5407 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33823
I20260809 06:32:01.218041 5407 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:01.218611 5407 heartbeater.cc:511] Master 127.30.78.126:33823 requested a full tablet report, sending...
I20260809 06:32:01.219854 4736 ts_manager.cc:194] Registered new tserver with Master: 369a5340e5bd4b78b33216792d4e45a7 (127.30.78.67:35677)
I20260809 06:32:01.220619 4736 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:36665
I20260809 06:32:01.227566 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:32:01.244292 5016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.231852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42752 (local address 127.30.78.126:33823)
0809 06:32:01.232035 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.232042 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.232533 (+ 491us) server_negotiation.cc:407] Connection header received
0809 06:32:01.232657 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.232661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.232718 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.232792 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:01.234145 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.234846 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.236515 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.236956 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.237047 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.239791 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:01.239796 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:01.239799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:01.239827 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:01.242205 (+ 2378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.242769 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.242773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.242775 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.242893 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.243145 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.243147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.243149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.243454 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:01.243632 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.243854 (+ 222us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.244005 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:32:01.248039 4736 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42752:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:32:01.254869 4736 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:32:01.264731 5012 heartbeater.cc:503] Master 127.30.78.126:33823 was elected leader, sending a full tablet report...
I20260809 06:32:01.283546 5427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.266591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49974 (local address 127.30.78.66:41147)
0809 06:32:01.274144 (+ 7553us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.274151 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.274716 (+ 565us) server_negotiation.cc:407] Connection header received
0809 06:32:01.274967 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.274973 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.275207 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.275403 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:01.276388 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.278109 (+ 1721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.280950 (+ 2841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.282357 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.282487 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.282689 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.283082 (+ 393us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.283247 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7411,"thread_start_us":7318,"threads_started":1}
I20260809 06:32:01.283689 5424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.266390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41147 (local address 127.0.0.1:49974)
0809 06:32:01.274567 (+ 8177us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:01.274598 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:01.274771 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:01.275689 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:01.275696 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:01.275729 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:01.276151 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.276165 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.278292 (+ 2127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.278303 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.280749 (+ 2446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.280760 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.282578 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.282585 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.282818 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.282891 (+ 73us) client_negotiation.cc:769] Sending connection context
0809 06:32:01.283027 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 06:32:01.283243 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7991,"mutex_wait_us":44,"thread_start_us":7879,"threads_started":1}
I20260809 06:32:01.286578 5429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.266759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:36205 (local address 127.0.0.1:39762)
0809 06:32:01.278396 (+ 11637us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:01.278417 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:01.279069 (+ 652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:01.279750 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:01.279755 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:01.279777 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:01.280219 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.280232 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.281974 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.281980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.283812 (+ 1832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.283826 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.285850 (+ 2024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.285857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.285972 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.285994 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 06:32:01.286071 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 06:32:01.286186 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11511,"mutex_wait_us":27,"thread_start_us":11379,"threads_started":1}
I20260809 06:32:01.286578 5428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.267025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39762 (local address 127.30.78.65:36205)
0809 06:32:01.267650 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.267660 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.278525 (+ 10865us) server_negotiation.cc:407] Connection header received
0809 06:32:01.279261 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.279269 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.279504 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.279705 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:01.280421 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.281854 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.283993 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.285421 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.285503 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.285653 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.286132 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.286290 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":489,"threads_started":1}
I20260809 06:32:01.287817 5430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.275173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:35677 (local address 127.0.0.1:60874)
0809 06:32:01.279574 (+ 4401us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:01.279588 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:01.279706 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:01.280288 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:01.280293 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:01.280320 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:01.280748 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.280760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.282718 (+ 1958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.282723 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.284915 (+ 2192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.284932 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.287060 (+ 2128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.287066 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.287223 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.287253 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:32:01.287348 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 06:32:01.287470 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4297,"mutex_wait_us":1,"thread_start_us":4121,"threads_started":1}
I20260809 06:32:01.287650 5114 tablet_service.cc:1467] Processing CreateTablet for tablet da374c31b2bc4009ba3fdf01d653e157 (DEFAULT_TABLE table=test-table [id=86aa2164bae748049ab8a6e4e1628b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:01.289078 5114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da374c31b2bc4009ba3fdf01d653e157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:01.289589 4918 tablet_service.cc:1467] Processing CreateTablet for tablet da374c31b2bc4009ba3fdf01d653e157 (DEFAULT_TABLE table=test-table [id=86aa2164bae748049ab8a6e4e1628b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:01.290333 5431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.275490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60874 (local address 127.30.78.67:35677)
0809 06:32:01.279136 (+ 3646us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.279144 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.279679 (+ 535us) server_negotiation.cc:407] Connection header received
0809 06:32:01.279880 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.279888 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.280095 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.280277 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:01.280971 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.282559 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.285100 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.286456 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.286574 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.286918 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.289839 (+ 2921us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.290002 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3486,"thread_start_us":3311,"threads_started":1}
I20260809 06:32:01.290675 4918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da374c31b2bc4009ba3fdf01d653e157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:01.293664 5321 tablet_service.cc:1467] Processing CreateTablet for tablet da374c31b2bc4009ba3fdf01d653e157 (DEFAULT_TABLE table=test-table [id=86aa2164bae748049ab8a6e4e1628b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:01.294939 5321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da374c31b2bc4009ba3fdf01d653e157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:01.300920 5432 tablet_bootstrap.cc:492] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: Bootstrap starting.
I20260809 06:32:01.303853 5432 tablet_bootstrap.cc:654] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:01.304375 5433 tablet_bootstrap.cc:492] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: Bootstrap starting.
I20260809 06:32:01.305274 5432 log.cc:824] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:01.307602 5433 tablet_bootstrap.cc:654] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:01.308248 5432 tablet_bootstrap.cc:492] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: No bootstrap required, opened a new log
I20260809 06:32:01.308527 5432 ts_tablet_manager.cc:1397] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 06:32:01.308634 5433 log.cc:824] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:01.309023 5437 tablet_bootstrap.cc:492] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: Bootstrap starting.
I20260809 06:32:01.312327 5433 tablet_bootstrap.cc:492] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: No bootstrap required, opened a new log
I20260809 06:32:01.312330 5437 tablet_bootstrap.cc:654] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:01.312597 5433 ts_tablet_manager.cc:1397] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 06:32:01.313494 5437 log.cc:824] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:01.316511 5432 raft_consensus.cc:348] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } }
I20260809 06:32:01.316833 5432 raft_consensus.cc:374] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:01.316917 5437 tablet_bootstrap.cc:492] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: No bootstrap required, opened a new log
I20260809 06:32:01.316936 5432 raft_consensus.cc:729] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ac9e949a54a43ac85ffab28b330d915, State: Initialized, Role: FOLLOWER
I20260809 06:32:01.317173 5437 ts_tablet_manager.cc:1397] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 06:32:01.317485 5432 consensus_queue.cc:260] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } }
I20260809 06:32:01.318500 5221 heartbeater.cc:503] Master 127.30.78.126:33823 was elected leader, sending a full tablet report...
I20260809 06:32:01.319113 5432 ts_tablet_manager.cc:1428] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260809 06:32:01.322207 5433 raft_consensus.cc:348] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } }
I20260809 06:32:01.322602 5433 raft_consensus.cc:374] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:01.322697 5433 raft_consensus.cc:729] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 304aac355dfa4395be1b840e17020f9a, State: Initialized, Role: FOLLOWER
I20260809 06:32:01.323371 5433 consensus_queue.cc:260] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } }
I20260809 06:32:01.325167 5433 ts_tablet_manager.cc:1428] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: Time spent starting tablet: real 0.012s user 0.012s sys 0.001s
I20260809 06:32:01.326982 5437 raft_consensus.cc:348] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } }
I20260809 06:32:01.327394 5437 raft_consensus.cc:374] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:01.327503 5437 raft_consensus.cc:729] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369a5340e5bd4b78b33216792d4e45a7, State: Initialized, Role: FOLLOWER
I20260809 06:32:01.328037 5437 consensus_queue.cc:260] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } }
I20260809 06:32:01.329114 5407 heartbeater.cc:503] Master 127.30.78.126:33823 was elected leader, sending a full tablet report...
I20260809 06:32:01.329768 5437 ts_tablet_manager.cc:1428] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260809 06:32:01.376521 5443 raft_consensus.cc:482] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:01.376837 5443 raft_consensus.cc:504] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } }
I20260809 06:32:01.378576 5443 leader_election.cc:288] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ac9e949a54a43ac85ffab28b330d915 (127.30.78.66:41147), 369a5340e5bd4b78b33216792d4e45a7 (127.30.78.67:35677)
I20260809 06:32:01.384595 5427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.378987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:40687 (local address 127.30.78.66:41147)
0809 06:32:01.379214 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.379221 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.379599 (+ 378us) server_negotiation.cc:407] Connection header received
0809 06:32:01.379821 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.379828 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.379911 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.379996 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:01.380571 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.381256 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.382995 (+ 1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.383744 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.383887 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.383960 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.384224 (+ 264us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.384342 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:32:01.384644 5447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.378881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41147 (local address 127.30.78.65:40687)
0809 06:32:01.379486 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:01.379503 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:01.379651 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:01.380095 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:01.380099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:01.380126 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:01.380444 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.380453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.381385 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.381389 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.382847 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.382860 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.383948 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.383953 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.384083 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.384107 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:32:01.384187 (+ 80us) client_negotiation.cc:240] Negotiation successful
0809 06:32:01.384304 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":325,"threads_started":1}
I20260809 06:32:01.385207 5448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.379599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:35677 (local address 127.30.78.65:50777)
0809 06:32:01.380164 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:01.380177 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:01.380307 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:01.380602 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:01.380606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:01.380629 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:01.380930 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.380939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.381943 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.381952 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.383290 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:01.383302 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.384406 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.384413 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:01.384541 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.384564 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 06:32:01.384645 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 06:32:01.384902 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":281,"threads_started":1}
I20260809 06:32:01.385072 5431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.379853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:50777 (local address 127.30.78.67:35677)
0809 06:32:01.380076 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.380081 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.380258 (+ 177us) server_negotiation.cc:407] Connection header received
0809 06:32:01.380433 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.380438 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.380494 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.380566 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:01.381075 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.381813 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.383436 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.384183 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.384322 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.384393 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.384683 (+ 290us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.384825 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 06:32:01.385584 5144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da374c31b2bc4009ba3fdf01d653e157" candidate_uuid: "304aac355dfa4395be1b840e17020f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ac9e949a54a43ac85ffab28b330d915" is_pre_election: true
I20260809 06:32:01.386080 5144 raft_consensus.cc:2454] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 304aac355dfa4395be1b840e17020f9a in term 0.
I20260809 06:32:01.386710 4851 leader_election.cc:302] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 304aac355dfa4395be1b840e17020f9a, 3ac9e949a54a43ac85ffab28b330d915; no voters:
I20260809 06:32:01.386672 5349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da374c31b2bc4009ba3fdf01d653e157" candidate_uuid: "304aac355dfa4395be1b840e17020f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369a5340e5bd4b78b33216792d4e45a7" is_pre_election: true
I20260809 06:32:01.387049 5443 raft_consensus.cc:2781] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:32:01.387123 5349 raft_consensus.cc:2454] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 304aac355dfa4395be1b840e17020f9a in term 0.
I20260809 06:32:01.387187 5443 raft_consensus.cc:482] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:01.387282 5443 raft_consensus.cc:3037] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:01.389446 5443 raft_consensus.cc:504] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } }
I20260809 06:32:01.390035 5443 leader_election.cc:288] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [CANDIDATE]: Term 1 election: Requested vote from peers 3ac9e949a54a43ac85ffab28b330d915 (127.30.78.66:41147), 369a5340e5bd4b78b33216792d4e45a7 (127.30.78.67:35677)
I20260809 06:32:01.390359 5144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da374c31b2bc4009ba3fdf01d653e157" candidate_uuid: "304aac355dfa4395be1b840e17020f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ac9e949a54a43ac85ffab28b330d915"
I20260809 06:32:01.390461 5349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da374c31b2bc4009ba3fdf01d653e157" candidate_uuid: "304aac355dfa4395be1b840e17020f9a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369a5340e5bd4b78b33216792d4e45a7"
I20260809 06:32:01.390530 5144 raft_consensus.cc:3037] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:01.390638 5349 raft_consensus.cc:3037] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:01.392666 5144 raft_consensus.cc:2454] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 304aac355dfa4395be1b840e17020f9a in term 1.
I20260809 06:32:01.392761 5349 raft_consensus.cc:2454] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 304aac355dfa4395be1b840e17020f9a in term 1.
I20260809 06:32:01.393064 4851 leader_election.cc:302] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 304aac355dfa4395be1b840e17020f9a, 3ac9e949a54a43ac85ffab28b330d915; no voters:
I20260809 06:32:01.393314 5443 raft_consensus.cc:2781] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:01.393771 5443 raft_consensus.cc:686] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 1 LEADER]: Becoming Leader. State: Replica: 304aac355dfa4395be1b840e17020f9a, State: Running, Role: LEADER
I20260809 06:32:01.394208 5443 consensus_queue.cc:237] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } }
I20260809 06:32:01.398344 4734 catalog_manager.cc:5495] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a reported cstate change: term changed from 0 to 1, leader changed from <none> to 304aac355dfa4395be1b840e17020f9a (127.30.78.65). New cstate: current_term: 1 leader_uuid: "304aac355dfa4395be1b840e17020f9a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "304aac355dfa4395be1b840e17020f9a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 36205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 } health_report { overall_health: UNKNOWN } } }
I20260809 06:32:01.437575 5428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.433057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39764 (local address 127.30.78.65:36205)
0809 06:32:01.433208 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.433212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.433234 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:32:01.433413 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.433417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.433489 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.433607 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:01.433942 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.434625 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.435881 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.436266 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.436346 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.436720 (+ 374us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:01.437166 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:01.437268 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.437322 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.437389 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 06:32:01.445312 5144 raft_consensus.cc:1261] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [term 1 FOLLOWER]: Refusing update from remote peer 304aac355dfa4395be1b840e17020f9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:01.445312 5349 raft_consensus.cc:1261] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [term 1 FOLLOWER]: Refusing update from remote peer 304aac355dfa4395be1b840e17020f9a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:01.446306 5450 consensus_queue.cc:1035] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ac9e949a54a43ac85ffab28b330d915" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:01.446652 5443 consensus_queue.cc:1035] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [LEADER]: Connected to new peer: Peer: permanent_uuid: "369a5340e5bd4b78b33216792d4e45a7" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 35677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 06:32:01.448289 5409 tablet.cc:2369] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:32:01.454631 5222 tablet.cc:2369] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:32:01.457209 5453 mvcc.cc:205] Tried to move back new op lower bound from 7316509169430196224 to 7316509169233948672. Current Snapshot: MvccSnapshot[applied={T|T < 7316509169430196224}]
I20260809 06:32:01.458963 5455 mvcc.cc:205] Tried to move back new op lower bound from 7316509169430196224 to 7316509169233948672. Current Snapshot: MvccSnapshot[applied={T|T < 7316509169430196224}]
I20260809 06:32:01.470850 4734 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:01.471140 4734 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:01.474506 4734 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8997b90fcdda497fa84ee73d666be2b1: Sending DeleteTablet for 3 replicas of tablet da374c31b2bc4009ba3fdf01d653e157
I20260809 06:32:01.475471 5114 tablet_service.cc:1514] Processing DeleteTablet for tablet da374c31b2bc4009ba3fdf01d653e157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:01 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:49974
I20260809 06:32:01.475557 4918 tablet_service.cc:1514] Processing DeleteTablet for tablet da374c31b2bc4009ba3fdf01d653e157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:01 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:39762
I20260809 06:32:01.475823 5321 tablet_service.cc:1514] Processing DeleteTablet for tablet da374c31b2bc4009ba3fdf01d653e157 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:01 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:60874
I20260809 06:32:01.477617 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 4826
I20260809 06:32:01.494328 5468 tablet_replica.cc:330] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: stopping tablet replica
I20260809 06:32:01.494458 5467 tablet_replica.cc:330] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: stopping tablet replica
I20260809 06:32:01.494899 5467 raft_consensus.cc:2229] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:32:01.494971 5468 raft_consensus.cc:2229] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:01.495548 5467 raft_consensus.cc:2258] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:01.495623 5468 raft_consensus.cc:2258] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:01.498310 5466 tablet_replica.cc:330] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: stopping tablet replica
I20260809 06:32:01.498348 5467 ts_tablet_manager.cc:1905] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:01.499336 5468 ts_tablet_manager.cc:1905] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 06:32:01 dist-test-slave-cvwc krb5kdc[4663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:32:01.502975 5466 raft_consensus.cc:2229] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:01.503551 5466 raft_consensus.cc:2258] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:01.506095 5468 ts_tablet_manager.cc:1918] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:01.506253 5468 log.cc:1196] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/da374c31b2bc4009ba3fdf01d653e157
I20260809 06:32:01.506381 5467 ts_tablet_manager.cc:1918] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:01.506538 5467 log.cc:1196] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/da374c31b2bc4009ba3fdf01d653e157
I20260809 06:32:01.506764 5468 ts_tablet_manager.cc:1939] T da374c31b2bc4009ba3fdf01d653e157 P 369a5340e5bd4b78b33216792d4e45a7: Deleting consensus metadata
I20260809 06:32:01.507107 5467 ts_tablet_manager.cc:1939] T da374c31b2bc4009ba3fdf01d653e157 P 304aac355dfa4395be1b840e17020f9a: Deleting consensus metadata
I20260809 06:32:01.508514 4714 catalog_manager.cc:4841] TS 369a5340e5bd4b78b33216792d4e45a7 (127.30.78.67:35677): tablet da374c31b2bc4009ba3fdf01d653e157 (table test-table [id=86aa2164bae748049ab8a6e4e1628b3b]) successfully deleted
I20260809 06:32:01.508669 4709 catalog_manager.cc:4841] TS 304aac355dfa4395be1b840e17020f9a (127.30.78.65:36205): tablet da374c31b2bc4009ba3fdf01d653e157 (table test-table [id=86aa2164bae748049ab8a6e4e1628b3b]) successfully deleted
I20260809 06:32:01.510376 5466 ts_tablet_manager.cc:1905] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:01.512319 5428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.479155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39770 (local address 127.30.78.65:36205)
0809 06:32:01.479317 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.479322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.484766 (+ 5444us) server_negotiation.cc:407] Connection header received
0809 06:32:01.485617 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.485623 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.485707 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.485801 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:01.490402 (+ 4601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.491827 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.496118 (+ 4291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.496878 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.496982 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.503835 (+ 6853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:01.503851 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:01.503867 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:01.503911 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:01.508135 (+ 4224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.509293 (+ 1158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.509301 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.509304 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.509516 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.510046 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.510051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.510055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.510472 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:01.510827 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.511158 (+ 331us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.511410 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:32:01.513121 5003 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:01.516762 5466 ts_tablet_manager.cc:1918] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:01.516927 5466 log.cc:1196] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/da374c31b2bc4009ba3fdf01d653e157
I20260809 06:32:01.517422 5466 ts_tablet_manager.cc:1939] T da374c31b2bc4009ba3fdf01d653e157 P 3ac9e949a54a43ac85ffab28b330d915: Deleting consensus metadata
I20260809 06:32:01.519001 4714 catalog_manager.cc:4841] TS 3ac9e949a54a43ac85ffab28b330d915 (127.30.78.66:41147): tablet da374c31b2bc4009ba3fdf01d653e157 (table test-table [id=86aa2164bae748049ab8a6e4e1628b3b]) successfully deleted
I20260809 06:32:01.608867 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 4826
I20260809 06:32:01.630687 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 5026
Aug 09 06:32:01 dist-test-slave-cvwc krb5kdc[4663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:32:01.644745 5427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.631414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49988 (local address 127.30.78.66:41147)
0809 06:32:01.631587 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.631592 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.631611 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:32:01.631796 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.631800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.631902 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.631990 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:01.633189 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.633967 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.635153 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.635553 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.635663 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.639606 (+ 3943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:01.639619 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:01.639633 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:01.639666 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:01.642130 (+ 2464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.642754 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.642761 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.642763 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.642883 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.643245 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.643249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.643251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.643614 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:01.643892 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.644192 (+ 300us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.644407 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:32:01.645337 5213 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:01.739899 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 5026
I20260809 06:32:01.762979 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 5228
Aug 09 06:32:01 dist-test-slave-cvwc krb5kdc[4663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:32:01.776253 5431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:01.763717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60882 (local address 127.30.78.67:35677)
0809 06:32:01.763879 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:01.763884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:01.763902 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:32:01.764038 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:01.764042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:01.764117 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:01.764198 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:01.765379 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.766127 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.767242 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:01.767610 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:01.767693 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:01.771531 (+ 3838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:01.771545 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:01.771562 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:01.771593 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:01.774188 (+ 2595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.774694 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.774701 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.774703 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.774834 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:01.775105 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:01.775108 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:01.775110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:01.775450 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:01.775652 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:01.775848 (+ 196us) server_negotiation.cc:299] Negotiation successful
0809 06:32:01.776006 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:32:01.776831 5396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:01.864500 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 5228
I20260809 06:32:01.883126 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 4686
I20260809 06:32:01.884164 4777 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:01.989253 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 4686
2026-08-09T06:32:02Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4098 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-09T06:32:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:02Z Disabled control of system clock
I20260809 06:32:02.059551 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36127
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:33869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:36127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 06:32:02.368305 5480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:02.368569 5480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:02.368659 5480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:02.375533 5480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:02.375626 5480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:02.375669 5480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:02.375723 5480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:02.375765 5480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:02.384722 5480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:36127
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:02.385934 5480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:02.387599 5480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:02.402173 5487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:02.402308 5488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:02.402874 5495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:02.403483 5480 server_base.cc:1034] running on GCE node
I20260809 06:32:02.404271 5480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:02.405517 5480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:02.406711 5480 hybrid_clock.cc:648] HybridClock initialized: now 1786257122406657 us; error 44 us; skew 500 ppm
I20260809 06:32:02.407027 5480 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:02.409047 5480 webserver.cc:460] Webserver started at http://127.30.78.126:37103/ using document root <none> and password file <none>
I20260809 06:32:02.409687 5480 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:02.409816 5480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:02.410130 5480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:02.412794 5480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "a535021406034a069bf20cade8307aa6"
format_stamp: "Formatted at 2026-08-09 06:32:02 on dist-test-slave-cvwc"
server_key: "81e72c269a7b9c5478f26250c4c90660"
server_key_iv: "d562cdb27eb43a3c274b691898d99f8c"
server_key_version: "encryptionkey@0"
I20260809 06:32:02.413547 5480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "a535021406034a069bf20cade8307aa6"
format_stamp: "Formatted at 2026-08-09 06:32:02 on dist-test-slave-cvwc"
server_key: "81e72c269a7b9c5478f26250c4c90660"
server_key_iv: "d562cdb27eb43a3c274b691898d99f8c"
server_key_version: "encryptionkey@0"
I20260809 06:32:02.418236 5480 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 06:32:02.421305 5504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:02.422482 5480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:32:02.422626 5480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "a535021406034a069bf20cade8307aa6"
format_stamp: "Formatted at 2026-08-09 06:32:02 on dist-test-slave-cvwc"
server_key: "81e72c269a7b9c5478f26250c4c90660"
server_key_iv: "d562cdb27eb43a3c274b691898d99f8c"
server_key_version: "encryptionkey@0"
I20260809 06:32:02.422811 5480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:02.428356 5480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:02.429030 5480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:02.429286 5480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:02.445667 5480 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:36127
I20260809 06:32:02.445703 5581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:36127 every 8 connection(s)
I20260809 06:32:02.446918 5480 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:02.450402 5584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:02.455067 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 5480
I20260809 06:32:02.455265 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:02.456035 31033 external_mini_cluster.cc:1428] Setting key abcd060cb051b67e52d8487aeee32c4a
I20260809 06:32:02.461208 5584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6: Bootstrap starting.
I20260809 06:32:02.463994 5589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:02.458033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57196 (local address 127.30.78.126:36127)
0809 06:32:02.459007 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:02.459020 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:02.459066 (+ 46us) server_negotiation.cc:407] Connection header received
0809 06:32:02.460768 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:02.460791 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:02.461158 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:02.461495 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:02.462531 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:02.462537 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:02.462549 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:02.462564 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:02.462628 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:02.462644 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:02.462828 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:02.462931 (+ 103us) server_negotiation.cc:299] Negotiation successful
0809 06:32:02.463148 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":365,"threads_started":1}
I20260809 06:32:02.464658 5584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:02.465620 5584 log.cc:824] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:02.468103 5584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6: No bootstrap required, opened a new log
I20260809 06:32:02.474702 5584 raft_consensus.cc:348] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a535021406034a069bf20cade8307aa6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36127 } }
I20260809 06:32:02.475018 5584 raft_consensus.cc:374] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:02.475101 5584 raft_consensus.cc:729] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a535021406034a069bf20cade8307aa6, State: Initialized, Role: FOLLOWER
I20260809 06:32:02.475591 5584 consensus_queue.cc:260] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a535021406034a069bf20cade8307aa6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36127 } }
I20260809 06:32:02.475795 5584 raft_consensus.cc:388] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:02.475924 5584 raft_consensus.cc:482] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:02.476065 5584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:02.478067 5584 raft_consensus.cc:504] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a535021406034a069bf20cade8307aa6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36127 } }
I20260809 06:32:02.478541 5584 leader_election.cc:302] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a535021406034a069bf20cade8307aa6; no voters:
I20260809 06:32:02.479122 5584 leader_election.cc:288] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:02.479245 5591 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:02.480073 5591 raft_consensus.cc:686] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [term 1 LEADER]: Becoming Leader. State: Replica: a535021406034a069bf20cade8307aa6, State: Running, Role: LEADER
I20260809 06:32:02.480547 5591 consensus_queue.cc:237] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a535021406034a069bf20cade8307aa6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36127 } }
I20260809 06:32:02.481033 5584 sys_catalog.cc:564] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:02.483127 5593 sys_catalog.cc:455] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a535021406034a069bf20cade8307aa6. Latest consensus state: current_term: 1 leader_uuid: "a535021406034a069bf20cade8307aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a535021406034a069bf20cade8307aa6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36127 } } }
I20260809 06:32:02.483546 5593 sys_catalog.cc:458] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:02.483340 5592 sys_catalog.cc:455] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a535021406034a069bf20cade8307aa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a535021406034a069bf20cade8307aa6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36127 } } }
I20260809 06:32:02.483672 5592 sys_catalog.cc:458] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:02.485111 5601 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:02.490044 5601 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:02.498054 5601 catalog_manager.cc:1347] Generated new cluster ID: c05ee85c79f4460cb4751c772a6c1db7
I20260809 06:32:02.498150 5601 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:02.528476 5601 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:02.528929 5601 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:02.544965 5601 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6: Generated new TSK 0
I20260809 06:32:02.545869 5601 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:32:02.563120 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36127
--builtin_ntp_servers=127.30.78.84:33869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 06:32:02.876190 5622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:02.876459 5622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:02.876595 5622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:02.883824 5622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:02.883930 5622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:02.884084 5622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:02.892881 5622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:02.894106 5622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:02.895852 5622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:02.907907 5630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:02.907944 5631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:02.907984 5635 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:02.909006 5622 server_base.cc:1034] running on GCE node
I20260809 06:32:02.909533 5622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:02.910481 5622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:02.911664 5622 hybrid_clock.cc:648] HybridClock initialized: now 1786257122911615 us; error 38 us; skew 500 ppm
I20260809 06:32:02.911969 5622 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:02.914059 5622 webserver.cc:460] Webserver started at http://127.30.78.65:35741/ using document root <none> and password file <none>
I20260809 06:32:02.914682 5622 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:02.914786 5622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:02.915091 5622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:02.917881 5622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "0794f043d3a148e2b525890756274b1f"
format_stamp: "Formatted at 2026-08-09 06:32:02 on dist-test-slave-cvwc"
server_key: "7ca36f052d7cdcea172650c6fd9ce2ac"
server_key_iv: "d79127e710b1e9b5da696cc22ded37e5"
server_key_version: "encryptionkey@0"
I20260809 06:32:02.918695 5622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "0794f043d3a148e2b525890756274b1f"
format_stamp: "Formatted at 2026-08-09 06:32:02 on dist-test-slave-cvwc"
server_key: "7ca36f052d7cdcea172650c6fd9ce2ac"
server_key_iv: "d79127e710b1e9b5da696cc22ded37e5"
server_key_version: "encryptionkey@0"
I20260809 06:32:02.923744 5622 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 06:32:02.927071 5642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:02.928274 5622 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:32:02.928428 5622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "0794f043d3a148e2b525890756274b1f"
format_stamp: "Formatted at 2026-08-09 06:32:02 on dist-test-slave-cvwc"
server_key: "7ca36f052d7cdcea172650c6fd9ce2ac"
server_key_iv: "d79127e710b1e9b5da696cc22ded37e5"
server_key_version: "encryptionkey@0"
I20260809 06:32:02.928619 5622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:02.933946 5622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:02.934669 5622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:02.934906 5622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:02.935724 5622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:02.937043 5622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:02.937136 5622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:02.937239 5622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:02.937306 5622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:02.966454 5622 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:32801
I20260809 06:32:02.966512 5820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:32801 every 8 connection(s)
I20260809 06:32:02.967638 5622 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:02.971805 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 5622
I20260809 06:32:02.971998 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:32:02.972795 31033 external_mini_cluster.cc:1428] Setting key 5689452f0756f6c03d0c7aecd7b6c886
I20260809 06:32:02.975895 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36127
--builtin_ntp_servers=127.30.78.84:33869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260809 06:32:02.975943 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:02.969954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:40047 (local address 127.30.78.126:36127)
0809 06:32:02.970360 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:02.970365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:02.971564 (+ 1199us) server_negotiation.cc:407] Connection header received
0809 06:32:02.973707 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:02.973732 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:02.973796 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:02.973901 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:02.975232 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:02.975237 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:02.975241 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:02.975260 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:02.975310 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:02.975326 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:02.975470 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:02.975599 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 06:32:02.975662 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":202,"threads_started":1}
I20260809 06:32:02.976713 5825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:02.970512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36127 (local address 127.30.78.65:40047)
0809 06:32:02.971377 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:02.971434 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:02.973462 (+ 2028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:02.974155 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:02.974165 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:02.974272 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:02.974949 (+ 677us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:02.974951 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:02.974988 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:02.975066 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:02.975427 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:02.975432 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:02.975437 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:32:02.975629 (+ 192us) client_negotiation.cc:240] Negotiation successful
0809 06:32:02.975804 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":247,"threads_started":1}
I20260809 06:32:02.978102 5821 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36127
I20260809 06:32:02.978356 5821 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:02.978897 5821 heartbeater.cc:511] Master 127.30.78.126:36127 requested a full tablet report, sending...
I20260809 06:32:02.980723 5533 ts_manager.cc:194] Registered new tserver with Master: 0794f043d3a148e2b525890756274b1f (127.30.78.65:32801)
W20260809 06:32:03.287119 5826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:03.287384 5826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:03.287508 5826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:03.294441 5826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:03.294533 5826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:03.294684 5826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:03.303309 5826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:03.304473 5826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:03.306196 5826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:03.318080 5839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:03.318145 5836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:03.318125 5837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:03.318938 5826 server_base.cc:1034] running on GCE node
I20260809 06:32:03.319511 5826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:03.320340 5826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:03.321538 5826 hybrid_clock.cc:648] HybridClock initialized: now 1786257123321487 us; error 40 us; skew 500 ppm
I20260809 06:32:03.321863 5826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:03.323962 5826 webserver.cc:460] Webserver started at http://127.30.78.66:34391/ using document root <none> and password file <none>
I20260809 06:32:03.324579 5826 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:03.324678 5826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:03.324991 5826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:03.327911 5826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "fba6ba47901f4afbbfbefebf5af9022a"
format_stamp: "Formatted at 2026-08-09 06:32:03 on dist-test-slave-cvwc"
server_key: "26e39104eab59320cde37059e65ff0e4"
server_key_iv: "4e37a53a6b3ec47c56cb0bc459a13898"
server_key_version: "encryptionkey@0"
I20260809 06:32:03.328722 5826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "fba6ba47901f4afbbfbefebf5af9022a"
format_stamp: "Formatted at 2026-08-09 06:32:03 on dist-test-slave-cvwc"
server_key: "26e39104eab59320cde37059e65ff0e4"
server_key_iv: "4e37a53a6b3ec47c56cb0bc459a13898"
server_key_version: "encryptionkey@0"
I20260809 06:32:03.333750 5826 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:32:03.336891 5848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:03.338099 5826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.003s
I20260809 06:32:03.338243 5826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "fba6ba47901f4afbbfbefebf5af9022a"
format_stamp: "Formatted at 2026-08-09 06:32:03 on dist-test-slave-cvwc"
server_key: "26e39104eab59320cde37059e65ff0e4"
server_key_iv: "4e37a53a6b3ec47c56cb0bc459a13898"
server_key_version: "encryptionkey@0"
I20260809 06:32:03.338428 5826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:03.343490 5826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:03.344182 5826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:03.344409 5826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:03.345233 5826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:03.346524 5826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:03.346617 5826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:03.346715 5826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:03.346784 5826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:03.374285 5826 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:34421
I20260809 06:32:03.374333 6006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:34421 every 8 connection(s)
I20260809 06:32:03.375499 5826 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:03.382788 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.377840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:42017 (local address 127.30.78.126:36127)
0809 06:32:03.378011 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.378015 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:03.379304 (+ 1289us) server_negotiation.cc:407] Connection header received
0809 06:32:03.380877 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:03.380881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:03.380932 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:03.381014 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:03.382206 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:03.382210 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:03.382214 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:03.382234 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:03.382272 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:03.382285 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:03.382386 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:03.382521 (+ 135us) server_negotiation.cc:299] Negotiation successful
0809 06:32:03.382569 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:32:03.383592 6011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.378305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36127 (local address 127.30.78.66:42017)
0809 06:32:03.379166 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:03.379200 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:03.380625 (+ 1425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:03.381226 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:03.381233 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:03.381312 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:03.381919 (+ 607us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:03.381923 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:03.381965 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:03.382049 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:03.382368 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:03.382374 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:03.382382 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 06:32:03.382578 (+ 196us) client_negotiation.cc:240] Negotiation successful
0809 06:32:03.382750 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":259,"threads_started":1}
I20260809 06:32:03.384497 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 5826
I20260809 06:32:03.384652 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:32:03.384907 6007 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36127
I20260809 06:32:03.385192 6007 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:03.385241 31033 external_mini_cluster.cc:1428] Setting key 0cc9bb2ec09fb90ae7c95a73cc75dace
I20260809 06:32:03.385910 6007 heartbeater.cc:511] Master 127.30.78.126:36127 requested a full tablet report, sending...
I20260809 06:32:03.387192 5533 ts_manager.cc:194] Registered new tserver with Master: fba6ba47901f4afbbfbefebf5af9022a (127.30.78.66:34421)
I20260809 06:32:03.388185 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36127
--builtin_ntp_servers=127.30.78.84:33869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260809 06:32:03.711596 6013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:03.711874 6013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:03.712004 6013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:03.719090 6013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:03.719182 6013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:03.719321 6013 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:03.728183 6013 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36127
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:03.729439 6013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:03.731168 6013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:03.743446 6019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:03.743503 6022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:03.744098 6024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:03.744493 6013 server_base.cc:1034] running on GCE node
I20260809 06:32:03.745059 6013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:03.745975 6013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:03.747171 6013 hybrid_clock.cc:648] HybridClock initialized: now 1786257123747126 us; error 37 us; skew 500 ppm
I20260809 06:32:03.747462 6013 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:03.749548 6013 webserver.cc:460] Webserver started at http://127.30.78.67:42735/ using document root <none> and password file <none>
I20260809 06:32:03.750222 6013 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:03.750319 6013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:03.750634 6013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:03.753427 6013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "a3cb0e47bea54b0994e43664407dd096"
format_stamp: "Formatted at 2026-08-09 06:32:03 on dist-test-slave-cvwc"
server_key: "44fcff9f85de024500e0d2e86019e2d2"
server_key_iv: "0cf6e6539162c971ce558425265cf2ca"
server_key_version: "encryptionkey@0"
I20260809 06:32:03.754298 6013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "a3cb0e47bea54b0994e43664407dd096"
format_stamp: "Formatted at 2026-08-09 06:32:03 on dist-test-slave-cvwc"
server_key: "44fcff9f85de024500e0d2e86019e2d2"
server_key_iv: "0cf6e6539162c971ce558425265cf2ca"
server_key_version: "encryptionkey@0"
I20260809 06:32:03.759363 6013 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:32:03.762631 6032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:03.763813 6013 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:32:03.763973 6013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "a3cb0e47bea54b0994e43664407dd096"
format_stamp: "Formatted at 2026-08-09 06:32:03 on dist-test-slave-cvwc"
server_key: "44fcff9f85de024500e0d2e86019e2d2"
server_key_iv: "0cf6e6539162c971ce558425265cf2ca"
server_key_version: "encryptionkey@0"
I20260809 06:32:03.764173 6013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:03.769411 6013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:03.770219 6013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:03.770462 6013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:03.771308 6013 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:03.772622 6013 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:03.772716 6013 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:03.772823 6013 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:03.772900 6013 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:03.802881 6013 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:37705
I20260809 06:32:03.802924 6210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:37705 every 8 connection(s)
I20260809 06:32:03.804150 6013 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:03.805657 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 6013
I20260809 06:32:03.805836 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:32:03.806357 31033 external_mini_cluster.cc:1428] Setting key 6ed6d5b5aff4286f2acaf8c24a33c8f8
I20260809 06:32:03.811877 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.806785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:39607 (local address 127.30.78.126:36127)
0809 06:32:03.806989 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.806995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:03.808458 (+ 1463us) server_negotiation.cc:407] Connection header received
0809 06:32:03.810110 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:03.810114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:03.810164 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:03.810242 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:03.811345 (+ 1103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:03.811349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:03.811352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:03.811367 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:03.811406 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:03.811417 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:03.811500 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:03.811629 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 06:32:03.811675 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:32:03.812732 6214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.807279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36127 (local address 127.30.78.67:39607)
0809 06:32:03.808288 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:03.808337 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:03.809886 (+ 1549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:03.810436 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:03.810443 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:03.810528 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:03.811093 (+ 565us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:03.811095 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:03.811129 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:03.811209 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:03.811487 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:03.811493 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:03.811498 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:32:03.811686 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 06:32:03.811864 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":305,"threads_started":1}
I20260809 06:32:03.813920 6211 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36127
I20260809 06:32:03.814182 6211 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:03.814726 6211 heartbeater.cc:511] Master 127.30.78.126:36127 requested a full tablet report, sending...
I20260809 06:32:03.815979 5533 ts_manager.cc:194] Registered new tserver with Master: a3cb0e47bea54b0994e43664407dd096 (127.30.78.67:37705)
I20260809 06:32:03.821149 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:32:03.828364 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.825597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45752 (local address 127.30.78.126:36127)
0809 06:32:03.825807 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.825813 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:03.826403 (+ 590us) server_negotiation.cc:407] Connection header received
0809 06:32:03.826695 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:03.826701 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:03.826768 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:03.826863 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:03.827770 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:03.827776 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:03.827781 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:03.827799 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:03.827831 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:03.827843 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:03.827950 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:03.828039 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 06:32:03.828099 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:32:03.831900 5533 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45752:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:32:03.838856 5533 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:32:03.857493 6233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.851118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:37705 (local address 127.0.0.1:37320)
0809 06:32:03.852510 (+ 1392us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:03.852556 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:03.852704 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:03.855085 (+ 2381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:03.855094 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:03.855176 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:03.855907 (+ 731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:03.855910 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:03.855939 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:03.856036 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:03.856565 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:03.856579 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:03.856588 (+ 9us) client_negotiation.cc:769] Sending connection context
0809 06:32:03.856778 (+ 190us) client_negotiation.cc:240] Negotiation successful
0809 06:32:03.856874 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1087,"thread_start_us":1850,"threads_started":1}
I20260809 06:32:03.858285 6231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.851337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37320 (local address 127.30.78.67:37705)
0809 06:32:03.854531 (+ 3194us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.854539 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:03.854577 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:32:03.854650 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:03.854658 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:03.854887 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:03.855055 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:03.856192 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:03.856201 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:03.856215 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:03.856233 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:03.856290 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:03.856311 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:03.856499 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:03.857431 (+ 932us) server_negotiation.cc:299] Negotiation successful
0809 06:32:03.857539 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3004,"thread_start_us":2257,"threads_started":1}
I20260809 06:32:03.858315 6237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.852169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60394 (local address 127.30.78.65:32801)
0809 06:32:03.854327 (+ 2158us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.854335 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:03.854374 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:32:03.854446 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:03.854454 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:03.854694 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:03.854853 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:03.856673 (+ 1820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:03.856682 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:03.856696 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:03.856715 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:03.856777 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:03.856801 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:03.857815 (+ 1014us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:03.857894 (+ 79us) server_negotiation.cc:299] Negotiation successful
0809 06:32:03.858000 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2017,"thread_start_us":1895,"threads_started":1}
I20260809 06:32:03.858652 6230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.851599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32801 (local address 127.0.0.1:60394)
0809 06:32:03.853243 (+ 1644us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:03.853267 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:03.853360 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:03.855865 (+ 2505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:03.855870 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:03.855895 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:03.856477 (+ 582us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:03.856479 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:03.856492 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:03.856525 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:03.856942 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:03.856947 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:03.856952 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:32:03.857080 (+ 128us) client_negotiation.cc:240] Negotiation successful
0809 06:32:03.857139 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1506,"thread_start_us":721,"threads_started":1}
I20260809 06:32:03.860879 6238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.855046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59308 (local address 127.30.78.66:34421)
0809 06:32:03.856995 (+ 1949us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.857003 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:03.857821 (+ 818us) server_negotiation.cc:407] Connection header received
0809 06:32:03.858027 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:03.858035 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:03.858228 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:03.858882 (+ 654us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:03.860128 (+ 1246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:03.860136 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:03.860149 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:03.860168 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:03.860224 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:03.860249 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:03.860424 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:03.860487 (+ 63us) server_negotiation.cc:299] Negotiation successful
0809 06:32:03.860584 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1785,"thread_start_us":1665,"threads_started":1}
I20260809 06:32:03.861033 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.853352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:34421 (local address 127.0.0.1:59308)
0809 06:32:03.857428 (+ 4076us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:03.857447 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:03.857548 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:03.858652 (+ 1104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:03.858657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:03.858681 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:03.859897 (+ 1216us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:03.859901 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:03.859919 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:03.859967 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:03.860363 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:03.860368 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:03.860373 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:32:03.860521 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 06:32:03.860575 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3937,"thread_start_us":3783,"threads_started":1}
I20260809 06:32:03.862386 5714 tablet_service.cc:1467] Processing CreateTablet for tablet a4b67d4ab08d4181b648ad8a157ceb93 (DEFAULT_TABLE table=test-table [id=1deb8b27720941e299bb5f322c78e510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:03.862376 6113 tablet_service.cc:1467] Processing CreateTablet for tablet a4b67d4ab08d4181b648ad8a157ceb93 (DEFAULT_TABLE table=test-table [id=1deb8b27720941e299bb5f322c78e510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:03.863732 5714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4b67d4ab08d4181b648ad8a157ceb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:03.863762 6113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4b67d4ab08d4181b648ad8a157ceb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:03.864640 5919 tablet_service.cc:1467] Processing CreateTablet for tablet a4b67d4ab08d4181b648ad8a157ceb93 (DEFAULT_TABLE table=test-table [id=1deb8b27720941e299bb5f322c78e510]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:03.865924 5919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4b67d4ab08d4181b648ad8a157ceb93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:03.875344 6241 tablet_bootstrap.cc:492] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f: Bootstrap starting.
I20260809 06:32:03.877699 6243 tablet_bootstrap.cc:492] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: Bootstrap starting.
I20260809 06:32:03.879374 6244 tablet_bootstrap.cc:492] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: Bootstrap starting.
I20260809 06:32:03.879712 6241 tablet_bootstrap.cc:654] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:03.881604 6243 tablet_bootstrap.cc:654] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:03.881610 6241 log.cc:824] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:03.882642 6244 tablet_bootstrap.cc:654] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:03.882890 6243 log.cc:824] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:03.883709 6244 log.cc:824] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:03.885030 6241 tablet_bootstrap.cc:492] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f: No bootstrap required, opened a new log
I20260809 06:32:03.885352 6241 ts_tablet_manager.cc:1397] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 06:32:03.886138 6243 tablet_bootstrap.cc:492] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: No bootstrap required, opened a new log
I20260809 06:32:03.886430 6243 ts_tablet_manager.cc:1397] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 06:32:03.887514 6244 tablet_bootstrap.cc:492] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: No bootstrap required, opened a new log
I20260809 06:32:03.887734 6244 ts_tablet_manager.cc:1397] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260809 06:32:03.894487 6244 raft_consensus.cc:348] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } }
I20260809 06:32:03.894816 6244 raft_consensus.cc:374] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:03.894927 6244 raft_consensus.cc:729] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fba6ba47901f4afbbfbefebf5af9022a, State: Initialized, Role: FOLLOWER
I20260809 06:32:03.895470 6244 consensus_queue.cc:260] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } }
I20260809 06:32:03.895995 6241 raft_consensus.cc:348] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } }
I20260809 06:32:03.896422 6007 heartbeater.cc:503] Master 127.30.78.126:36127 was elected leader, sending a full tablet report...
I20260809 06:32:03.896442 6241 raft_consensus.cc:374] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:03.896544 6241 raft_consensus.cc:729] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0794f043d3a148e2b525890756274b1f, State: Initialized, Role: FOLLOWER
I20260809 06:32:03.897076 6244 ts_tablet_manager.cc:1428] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: Time spent starting tablet: real 0.009s user 0.005s sys 0.005s
I20260809 06:32:03.896901 6243 raft_consensus.cc:348] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } }
I20260809 06:32:03.897318 6243 raft_consensus.cc:374] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:03.897424 6243 raft_consensus.cc:729] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3cb0e47bea54b0994e43664407dd096, State: Initialized, Role: FOLLOWER
I20260809 06:32:03.897266 6241 consensus_queue.cc:260] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } }
I20260809 06:32:03.898403 5821 heartbeater.cc:503] Master 127.30.78.126:36127 was elected leader, sending a full tablet report...
I20260809 06:32:03.899101 6241 ts_tablet_manager.cc:1428] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260809 06:32:03.899371 6243 consensus_queue.cc:260] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } }
I20260809 06:32:03.903721 6253 raft_consensus.cc:482] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:03.903788 6211 heartbeater.cc:503] Master 127.30.78.126:36127 was elected leader, sending a full tablet report...
I20260809 06:32:03.904420 6243 ts_tablet_manager.cc:1428] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: Time spent starting tablet: real 0.018s user 0.012s sys 0.004s
I20260809 06:32:03.904472 6253 raft_consensus.cc:504] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } }
I20260809 06:32:03.906319 6253 leader_election.cc:288] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fba6ba47901f4afbbfbefebf5af9022a (127.30.78.66:34421), 0794f043d3a148e2b525890756274b1f (127.30.78.65:32801)
I20260809 06:32:03.909468 6237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.907083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:53437 (local address 127.30.78.65:32801)
0809 06:32:03.907219 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.907224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:03.907238 (+ 14us) server_negotiation.cc:407] Connection header received
0809 06:32:03.907278 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:03.907282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:03.907320 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:03.907405 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:03.908780 (+ 1375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:03.908786 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:03.908791 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:03.908830 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:03.908869 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:03.908886 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:03.908991 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:03.909165 (+ 174us) server_negotiation.cc:299] Negotiation successful
0809 06:32:03.909221 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 06:32:03.909466 6214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.906635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32801 (local address 127.30.78.67:53437)
0809 06:32:03.906984 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:03.907010 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:03.907119 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:03.907574 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:03.907579 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:03.907609 (+ 30us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:03.908568 (+ 959us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:03.908571 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:03.908593 (+ 22us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:03.908638 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:03.909047 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:03.909053 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:03.909058 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:32:03.909166 (+ 108us) client_negotiation.cc:240] Negotiation successful
0809 06:32:03.909220 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227}
I20260809 06:32:03.910241 6238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.906769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:45009 (local address 127.30.78.66:34421)
0809 06:32:03.906961 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.906967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:03.907957 (+ 990us) server_negotiation.cc:407] Connection header received
0809 06:32:03.908181 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:03.908187 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:03.908237 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:03.908333 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:03.909467 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:03.909473 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:03.909478 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:03.909499 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:03.909536 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:03.909554 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:03.909658 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:03.909977 (+ 319us) server_negotiation.cc:299] Negotiation successful
0809 06:32:03.910034 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:32:03.910513 6256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.906696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:34421 (local address 127.30.78.67:45009)
0809 06:32:03.907862 (+ 1166us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:03.907877 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:03.908040 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:03.908389 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:03.908395 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:03.908420 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:03.909198 (+ 778us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:03.909202 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:03.909236 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:03.909284 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:03.909802 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:03.909807 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:03.909811 (+ 4us) client_negotiation.cc:769] Sending connection context
0809 06:32:03.909987 (+ 176us) client_negotiation.cc:240] Negotiation successful
0809 06:32:03.910043 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1043,"thread_start_us":857,"threads_started":1}
I20260809 06:32:03.910552 5747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4b67d4ab08d4181b648ad8a157ceb93" candidate_uuid: "a3cb0e47bea54b0994e43664407dd096" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0794f043d3a148e2b525890756274b1f" is_pre_election: true
I20260809 06:32:03.911059 5747 raft_consensus.cc:2454] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3cb0e47bea54b0994e43664407dd096 in term 0.
I20260809 06:32:03.911270 5947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4b67d4ab08d4181b648ad8a157ceb93" candidate_uuid: "a3cb0e47bea54b0994e43664407dd096" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fba6ba47901f4afbbfbefebf5af9022a" is_pre_election: true
I20260809 06:32:03.911684 5947 raft_consensus.cc:2454] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3cb0e47bea54b0994e43664407dd096 in term 0.
I20260809 06:32:03.911720 6034 leader_election.cc:302] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0794f043d3a148e2b525890756274b1f, a3cb0e47bea54b0994e43664407dd096; no voters:
I20260809 06:32:03.912223 6253 raft_consensus.cc:2781] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:32:03.912382 6253 raft_consensus.cc:482] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:03.912497 6253 raft_consensus.cc:3037] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:03.914922 6253 raft_consensus.cc:504] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } }
I20260809 06:32:03.915498 6253 leader_election.cc:288] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [CANDIDATE]: Term 1 election: Requested vote from peers fba6ba47901f4afbbfbefebf5af9022a (127.30.78.66:34421), 0794f043d3a148e2b525890756274b1f (127.30.78.65:32801)
I20260809 06:32:03.915846 5947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4b67d4ab08d4181b648ad8a157ceb93" candidate_uuid: "a3cb0e47bea54b0994e43664407dd096" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fba6ba47901f4afbbfbefebf5af9022a"
I20260809 06:32:03.915961 5747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4b67d4ab08d4181b648ad8a157ceb93" candidate_uuid: "a3cb0e47bea54b0994e43664407dd096" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0794f043d3a148e2b525890756274b1f"
I20260809 06:32:03.916018 5947 raft_consensus.cc:3037] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:03.916153 5747 raft_consensus.cc:3037] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:03.918170 5947 raft_consensus.cc:2454] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3cb0e47bea54b0994e43664407dd096 in term 1.
I20260809 06:32:03.918493 5747 raft_consensus.cc:2454] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3cb0e47bea54b0994e43664407dd096 in term 1.
I20260809 06:32:03.918530 6036 leader_election.cc:302] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3cb0e47bea54b0994e43664407dd096, fba6ba47901f4afbbfbefebf5af9022a; no voters:
I20260809 06:32:03.918834 6253 raft_consensus.cc:2781] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:03.919000 6253 raft_consensus.cc:686] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 1 LEADER]: Becoming Leader. State: Replica: a3cb0e47bea54b0994e43664407dd096, State: Running, Role: LEADER
I20260809 06:32:03.919418 6253 consensus_queue.cc:237] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } }
I20260809 06:32:03.923272 5533 catalog_manager.cc:5495] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3cb0e47bea54b0994e43664407dd096 (127.30.78.67). New cstate: current_term: 1 leader_uuid: "a3cb0e47bea54b0994e43664407dd096" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3cb0e47bea54b0994e43664407dd096" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 37705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 } health_report { overall_health: UNKNOWN } } }
I20260809 06:32:03.935778 6231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.934022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37328 (local address 127.30.78.67:37705)
0809 06:32:03.934153 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.934157 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:03.934363 (+ 206us) server_negotiation.cc:407] Connection header received
0809 06:32:03.934523 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:03.934527 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:03.934591 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:03.934668 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:03.935346 (+ 678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:03.935350 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:03.935353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:03.935376 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:03.935416 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:03.935432 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:03.935527 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:03.935567 (+ 40us) server_negotiation.cc:299] Negotiation successful
0809 06:32:03.935607 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 06:32:03.943027 5947 raft_consensus.cc:1261] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [term 1 FOLLOWER]: Refusing update from remote peer a3cb0e47bea54b0994e43664407dd096: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:03.943186 5747 raft_consensus.cc:1261] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [term 1 FOLLOWER]: Refusing update from remote peer a3cb0e47bea54b0994e43664407dd096: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:03.943869 6254 consensus_queue.cc:1035] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fba6ba47901f4afbbfbefebf5af9022a" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 34421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:03.944203 6253 consensus_queue.cc:1035] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0794f043d3a148e2b525890756274b1f" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 32801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:03.954584 6259 mvcc.cc:205] Tried to move back new op lower bound from 7316509179662086144 to 7316509179577524224. Current Snapshot: MvccSnapshot[applied={T|T < 7316509179662086144}]
I20260809 06:32:03.959489 6260 mvcc.cc:205] Tried to move back new op lower bound from 7316509179662086144 to 7316509179577524224. Current Snapshot: MvccSnapshot[applied={T|T < 7316509179662086144}]
I20260809 06:32:03.973914 5533 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:03.974186 5533 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:03.978071 5533 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a535021406034a069bf20cade8307aa6: Sending DeleteTablet for 3 replicas of tablet a4b67d4ab08d4181b648ad8a157ceb93
I20260809 06:32:03.979252 6113 tablet_service.cc:1514] Processing DeleteTablet for tablet a4b67d4ab08d4181b648ad8a157ceb93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:03 UTC) from {username='slave'} at 127.0.0.1:37320
I20260809 06:32:03.979573 5919 tablet_service.cc:1514] Processing DeleteTablet for tablet a4b67d4ab08d4181b648ad8a157ceb93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:03 UTC) from {username='slave'} at 127.0.0.1:59308
I20260809 06:32:03.979573 5714 tablet_service.cc:1514] Processing DeleteTablet for tablet a4b67d4ab08d4181b648ad8a157ceb93 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:03 UTC) from {username='slave'} at 127.0.0.1:60394
I20260809 06:32:03.981460 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 5622
I20260809 06:32:04.008656 6237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:03.984582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60406 (local address 127.30.78.65:32801)
0809 06:32:03.984757 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:03.984764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:04.006020 (+ 21256us) server_negotiation.cc:407] Connection header received
0809 06:32:04.006469 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:04.006476 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:04.006588 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:04.006665 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:04.007834 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:04.007841 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:04.007846 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:04.007866 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:04.007916 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:04.007932 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:04.008030 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:04.008268 (+ 238us) server_negotiation.cc:299] Negotiation successful
0809 06:32:04.008333 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:32:04.009940 5814 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:04.010607 6275 tablet_replica.cc:330] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: stopping tablet replica
I20260809 06:32:04.011080 6272 tablet_replica.cc:330] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: stopping tablet replica
I20260809 06:32:04.011628 6275 raft_consensus.cc:2229] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:04.012194 6272 raft_consensus.cc:2229] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:32:04.012938 6272 raft_consensus.cc:2258] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:04.013494 6275 raft_consensus.cc:2258] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:04.016192 6275 ts_tablet_manager.cc:1905] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:04.017539 6272 ts_tablet_manager.cc:1905] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:04.025072 6272 ts_tablet_manager.cc:1918] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:04.032459 6275 ts_tablet_manager.cc:1918] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:04.033726 6272 log.cc:1196] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/a4b67d4ab08d4181b648ad8a157ceb93
I20260809 06:32:04.033403 6275 log.cc:1196] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/a4b67d4ab08d4181b648ad8a157ceb93
I20260809 06:32:04.034348 6272 ts_tablet_manager.cc:1939] T a4b67d4ab08d4181b648ad8a157ceb93 P a3cb0e47bea54b0994e43664407dd096: Deleting consensus metadata
I20260809 06:32:04.035130 6275 ts_tablet_manager.cc:1939] T a4b67d4ab08d4181b648ad8a157ceb93 P fba6ba47901f4afbbfbefebf5af9022a: Deleting consensus metadata
I20260809 06:32:04.036242 5506 catalog_manager.cc:4841] TS a3cb0e47bea54b0994e43664407dd096 (127.30.78.67:37705): tablet a4b67d4ab08d4181b648ad8a157ceb93 (table test-table [id=1deb8b27720941e299bb5f322c78e510]) successfully deleted
I20260809 06:32:04.037580 5506 catalog_manager.cc:4841] TS fba6ba47901f4afbbfbefebf5af9022a (127.30.78.66:34421): tablet a4b67d4ab08d4181b648ad8a157ceb93 (table test-table [id=1deb8b27720941e299bb5f322c78e510]) successfully deleted
I20260809 06:32:04.122648 6273 tablet_replica.cc:330] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f: stopping tablet replica
I20260809 06:32:04.123210 6273 raft_consensus.cc:2229] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:04.123592 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 5622
I20260809 06:32:04.123741 6273 raft_consensus.cc:2258] T a4b67d4ab08d4181b648ad8a157ceb93 P 0794f043d3a148e2b525890756274b1f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260809 06:32:04.144593 5505 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.78.65:32801 (error 108)
I20260809 06:32:04.145983 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 5826
I20260809 06:32:04.146428 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:04.145971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32801 (local address 127.0.0.1:60422)
0809 06:32:04.146143 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:04.146273 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 06:32:04.146835 5505 catalog_manager.cc:4584] TS 0794f043d3a148e2b525890756274b1f (127.30.78.65:32801): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a4b67d4ab08d4181b648ad8a157ceb93: Network error: Client connection negotiation failed: client connection to 127.30.78.65:32801: connect: Connection refused (error 111)
I20260809 06:32:04.149257 6238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:04.146862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59318 (local address 127.30.78.66:34421)
0809 06:32:04.147056 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:04.147062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:04.147083 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:32:04.147261 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:04.147265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:04.147356 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:04.147443 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:04.148281 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:04.148285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:04.148288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:04.148304 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:04.148344 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:04.148360 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:04.148479 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:04.148927 (+ 448us) server_negotiation.cc:299] Negotiation successful
0809 06:32:04.148991 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:32:04.150326 6000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:04.200495 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:04.199925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32801 (local address 127.0.0.1:60426)
0809 06:32:04.200172 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:04.200291 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260809 06:32:04.201686 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:04.201273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32801 (local address 127.0.0.1:60438)
0809 06:32:04.201434 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:04.201535 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 06:32:04.237095 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 5826
I20260809 06:32:04.261641 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 6013
I20260809 06:32:04.262301 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:04.261646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32801 (local address 127.0.0.1:60446)
0809 06:32:04.261990 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:04.262106 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
I20260809 06:32:04.263808 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:04.263424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32801 (local address 127.0.0.1:60452)
0809 06:32:04.263596 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:04.263681 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 06:32:04.264998 6231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:04.262518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37336 (local address 127.30.78.67:37705)
0809 06:32:04.262687 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:04.262694 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:04.262819 (+ 125us) server_negotiation.cc:407] Connection header received
0809 06:32:04.263062 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:04.263067 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:04.263136 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:04.263230 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:04.264290 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:04.264296 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:04.264300 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:04.264320 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:04.264360 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:04.264382 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:04.264540 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:04.264628 (+ 88us) server_negotiation.cc:299] Negotiation successful
0809 06:32:04.264688 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:32:04.265650 6204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:04.344609 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:04.344131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32801 (local address 127.0.0.1:60464)
0809 06:32:04.344341 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:04.344447 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260809 06:32:04.345667 6240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:04.345288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:32801 (local address 127.0.0.1:60480)
0809 06:32:04.345483 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:04.345552 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:32801: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 06:32:04.385834 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 6013
I20260809 06:32:04.411680 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 5480
I20260809 06:32:04.412744 5575 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:04.515442 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 5480
2026-08-09T06:32:04Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2521 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260809 06:32:04.558030 31033 mini_oidc.cc:152] Starting JWKS server
I20260809 06:32:04.560638 31033 webserver.cc:460] Webserver started at https://127.0.0.1:38653/ using document root <none> and password file <none>
I20260809 06:32:04.560940 31033 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 06:32:04.561542 31033 webserver.cc:460] Webserver started at http://127.0.0.1:36701/ using document root <none> and password file <none>
2026-08-09T06:32:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:04Z Disabled control of system clock
I20260809 06:32:04.589251 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43997
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:34997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:43997
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38653/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/testchainca.cert with env {}
W20260809 06:32:04.907737 6291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:04.907998 6291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:04.908089 6291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:04.915014 6291 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:04.915110 6291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:04.915154 6291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:04.915208 6291 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:04.915251 6291 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 06:32:04.915309 6291 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 06:32:04.915347 6291 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38653/jwks.json
I20260809 06:32:04.924706 6291 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:34997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:43997
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38653/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:04.925872 6291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:04.927055 6291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:04.937747 6298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:04.937824 6300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:04.938071 6303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:04.938707 6291 server_base.cc:1034] running on GCE node
I20260809 06:32:04.939463 6291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:04.940677 6291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:04.941855 6291 hybrid_clock.cc:648] HybridClock initialized: now 1786257124941808 us; error 38 us; skew 500 ppm
I20260809 06:32:04.942163 6291 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:04.944273 6291 webserver.cc:460] Webserver started at http://127.30.78.126:41325/ using document root <none> and password file <none>
I20260809 06:32:04.944881 6291 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:04.944988 6291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:04.945269 6291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:04.948130 6291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "632e7acc82c04e9eb13e3d78d46eaae0"
format_stamp: "Formatted at 2026-08-09 06:32:04 on dist-test-slave-cvwc"
server_key: "29b5e1938c1009aabe9752724a2a134c"
server_key_iv: "ce2dedfb46d0d3f526b8e8164f6b4a1a"
server_key_version: "encryptionkey@0"
I20260809 06:32:04.948941 6291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "632e7acc82c04e9eb13e3d78d46eaae0"
format_stamp: "Formatted at 2026-08-09 06:32:04 on dist-test-slave-cvwc"
server_key: "29b5e1938c1009aabe9752724a2a134c"
server_key_iv: "ce2dedfb46d0d3f526b8e8164f6b4a1a"
server_key_version: "encryptionkey@0"
I20260809 06:32:04.953545 6291 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260809 06:32:04.956786 6310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:04.958576 6291 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:32:04.958761 6291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "632e7acc82c04e9eb13e3d78d46eaae0"
format_stamp: "Formatted at 2026-08-09 06:32:04 on dist-test-slave-cvwc"
server_key: "29b5e1938c1009aabe9752724a2a134c"
server_key_iv: "ce2dedfb46d0d3f526b8e8164f6b4a1a"
server_key_version: "encryptionkey@0"
I20260809 06:32:04.958990 6291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:04.980266 6291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:04.980973 6291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:04.981218 6291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:04.997418 6291 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:43997
I20260809 06:32:04.997439 6388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:43997 every 8 connection(s)
I20260809 06:32:04.998694 6291 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:05.002164 6389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:05.008127 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 6291
I20260809 06:32:05.008308 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:05.008917 31033 external_mini_cluster.cc:1428] Setting key 039fcbb9a63a238094bd785860003966
I20260809 06:32:05.012382 6389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0: Bootstrap starting.
I20260809 06:32:05.016192 6389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:05.017419 6389 log.cc:824] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:05.020351 6389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0: No bootstrap required, opened a new log
I20260809 06:32:05.023943 6393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:05.010714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46020 (local address 127.30.78.126:43997)
0809 06:32:05.011697 (+ 983us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:05.011710 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:05.011761 (+ 51us) server_negotiation.cc:407] Connection header received
0809 06:32:05.014129 (+ 2368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:05.014157 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:05.014700 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:05.015106 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:05.015604 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.017524 (+ 1920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.019135 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.020105 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.020274 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:05.021281 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:05.021292 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:05.021309 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:05.021998 (+ 689us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:05.022102 (+ 104us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:05.022133 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:05.022248 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:05.022431 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 06:32:05.022729 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":294,"threads_started":1}
I20260809 06:32:05.027416 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:32:05.028568 6389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632e7acc82c04e9eb13e3d78d46eaae0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43997 } }
I20260809 06:32:05.028868 6389 raft_consensus.cc:374] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:05.028963 6389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 632e7acc82c04e9eb13e3d78d46eaae0, State: Initialized, Role: FOLLOWER
I20260809 06:32:05.029484 6389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632e7acc82c04e9eb13e3d78d46eaae0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43997 } }
I20260809 06:32:05.029778 6389 raft_consensus.cc:388] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:05.029908 6389 raft_consensus.cc:482] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:05.030076 6389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:05.032104 6389 raft_consensus.cc:504] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632e7acc82c04e9eb13e3d78d46eaae0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43997 } }
I20260809 06:32:05.032548 6389 leader_election.cc:302] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 632e7acc82c04e9eb13e3d78d46eaae0; no voters:
I20260809 06:32:05.033048 6389 leader_election.cc:288] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:05.033172 6397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:05.033830 6397 raft_consensus.cc:686] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [term 1 LEADER]: Becoming Leader. State: Replica: 632e7acc82c04e9eb13e3d78d46eaae0, State: Running, Role: LEADER
I20260809 06:32:05.034287 6397 consensus_queue.cc:237] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632e7acc82c04e9eb13e3d78d46eaae0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43997 } }
I20260809 06:32:05.034847 6389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:05.036850 6399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "632e7acc82c04e9eb13e3d78d46eaae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632e7acc82c04e9eb13e3d78d46eaae0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43997 } } }
I20260809 06:32:05.036924 6400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 632e7acc82c04e9eb13e3d78d46eaae0. Latest consensus state: current_term: 1 leader_uuid: "632e7acc82c04e9eb13e3d78d46eaae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "632e7acc82c04e9eb13e3d78d46eaae0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43997 } } }
I20260809 06:32:05.037276 6399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:05.037279 6400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:05.038920 6404 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:05.044049 6404 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:05.051553 6404 catalog_manager.cc:1347] Generated new cluster ID: f1a523190ebb4e37bb4b9f599516c520
I20260809 06:32:05.051652 6404 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:05.059844 6404 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:05.061473 6404 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:05.071772 6404 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 632e7acc82c04e9eb13e3d78d46eaae0: Generated new TSK 0
I20260809 06:32:05.072702 6404 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 06:32:05.116108 6429 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260809 06:32:05.116292 6429 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 06:32:05.117311 6393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:05.096445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46026 (local address 127.30.78.126:43997)
0809 06:32:05.096622 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:05.096628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:05.097160 (+ 532us) server_negotiation.cc:407] Connection header received
0809 06:32:05.097412 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:05.097421 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:05.097505 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:05.097653 (+ 148us) server_negotiation.cc:226] Negotiated authn=JWT
0809 06:32:05.098157 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.099311 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.100664 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.101330 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.101457 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:05.101906 (+ 449us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 06:32:05.116716 (+ 14810us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38653/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 06:32:05.117035 (+ 319us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46026: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38653/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 06:32:05.117439 6393 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46026: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38653/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260809 06:32:05.118691 6428 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:05.096441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43997 (local address 127.0.0.1:46026)
0809 06:32:05.097065 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:05.097080 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:05.097221 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:05.097655 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:05.097659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:05.097667 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 06:32:05.098015 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:05.098025 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.099449 (+ 1424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.099453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:05.100528 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:05.100539 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.101489 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.101493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:05.101610 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:05.101660 (+ 50us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 06:32:05.116934 (+ 15274us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38653/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0809 06:32:05.117157 (+ 223us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.78.126:43997: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38653/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":318,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.30.78.126:43997: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38653/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260809 06:32:05.120398 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 6291
I20260809 06:32:05.121308 6384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:05.211913 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 6291
2026-08-09T06:32:05Z chronyd exiting
I20260809 06:32:05.263702 31033 test_util.cc:175] -----------------------------------------------
I20260809 06:32:05.263842 31033 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786257083636440-31033-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (710 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260809 06:32:05.267592 31033 mini_oidc.cc:152] Starting JWKS server
I20260809 06:32:05.269353 31033 webserver.cc:460] Webserver started at https://127.0.0.1:42009/ using document root <none> and password file <none>
I20260809 06:32:05.269570 31033 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 06:32:05.270222 31033 webserver.cc:460] Webserver started at http://127.0.0.1:35477/ using document root <none> and password file <none>
2026-08-09T06:32:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:05Z Disabled control of system clock
I20260809 06:32:05.296416 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43021
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:45845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:43021
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42009/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/testchainca.cert with env {}
W20260809 06:32:05.602404 6444 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:05.602686 6444 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:05.602831 6444 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:05.609701 6444 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:05.609828 6444 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:05.609894 6444 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:05.609972 6444 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:05.610030 6444 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 06:32:05.610113 6444 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 06:32:05.610167 6444 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42009/jwks.json
I20260809 06:32:05.619480 6444 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:45845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:43021
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42009/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:05.620666 6444 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:05.621959 6444 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:05.632730 6454 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:05.632768 6458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:05.632820 6456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:05.633688 6444 server_base.cc:1034] running on GCE node
I20260809 06:32:05.634577 6444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:05.635844 6444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:05.637036 6444 hybrid_clock.cc:648] HybridClock initialized: now 1786257125636991 us; error 37 us; skew 500 ppm
I20260809 06:32:05.637339 6444 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:05.639400 6444 webserver.cc:460] Webserver started at http://127.30.78.126:37415/ using document root <none> and password file <none>
I20260809 06:32:05.640009 6444 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:05.640111 6444 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:05.640411 6444 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:05.643137 6444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "91cbceed653f42e695d79f22052c652e"
format_stamp: "Formatted at 2026-08-09 06:32:05 on dist-test-slave-cvwc"
server_key: "2c459ce90f045edce13205e03f570f24"
server_key_iv: "7d41e3b9bfb45938b6f5b02bc43dc597"
server_key_version: "encryptionkey@0"
I20260809 06:32:05.643883 6444 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "91cbceed653f42e695d79f22052c652e"
format_stamp: "Formatted at 2026-08-09 06:32:05 on dist-test-slave-cvwc"
server_key: "2c459ce90f045edce13205e03f570f24"
server_key_iv: "7d41e3b9bfb45938b6f5b02bc43dc597"
server_key_version: "encryptionkey@0"
I20260809 06:32:05.648669 6444 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 06:32:05.651796 6471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:05.652981 6444 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:05.653127 6444 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "91cbceed653f42e695d79f22052c652e"
format_stamp: "Formatted at 2026-08-09 06:32:05 on dist-test-slave-cvwc"
server_key: "2c459ce90f045edce13205e03f570f24"
server_key_iv: "7d41e3b9bfb45938b6f5b02bc43dc597"
server_key_version: "encryptionkey@0"
I20260809 06:32:05.653316 6444 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:05.682125 6444 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:05.682891 6444 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:05.683167 6444 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:05.699544 6444 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:43021
I20260809 06:32:05.699564 6563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:43021 every 8 connection(s)
I20260809 06:32:05.700790 6444 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:05.704270 6564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:05.710198 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 6444
I20260809 06:32:05.710362 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:05.710976 31033 external_mini_cluster.cc:1428] Setting key 066fb6c3252e74f6cb182fca157d250e
I20260809 06:32:05.714284 6564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e: Bootstrap starting.
I20260809 06:32:05.717427 6564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:05.718590 6564 log.cc:824] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:05.721487 6564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e: No bootstrap required, opened a new log
I20260809 06:32:05.723743 6568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:05.712722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34006 (local address 127.30.78.126:43021)
0809 06:32:05.713598 (+ 876us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:05.713609 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:05.713648 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:32:05.715301 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:05.715322 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:05.715754 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:05.716062 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:05.716604 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.717943 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.719575 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.720291 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.720418 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:05.721537 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:05.721543 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:05.721556 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:05.722149 (+ 593us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:05.722223 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:05.722243 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:05.722326 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:05.722544 (+ 218us) server_negotiation.cc:299] Negotiation successful
0809 06:32:05.722819 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":298,"threads_started":1}
I20260809 06:32:05.727361 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:32:05.730338 6564 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cbceed653f42e695d79f22052c652e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43021 } }
I20260809 06:32:05.730751 6564 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:05.730859 6564 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91cbceed653f42e695d79f22052c652e, State: Initialized, Role: FOLLOWER
I20260809 06:32:05.731426 6564 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cbceed653f42e695d79f22052c652e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43021 } }
I20260809 06:32:05.731635 6564 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:05.731729 6564 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:05.731844 6564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:05.733799 6564 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cbceed653f42e695d79f22052c652e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43021 } }
I20260809 06:32:05.734221 6564 leader_election.cc:302] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91cbceed653f42e695d79f22052c652e; no voters:
I20260809 06:32:05.734705 6564 leader_election.cc:288] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:05.734818 6573 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:05.735754 6573 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [term 1 LEADER]: Becoming Leader. State: Replica: 91cbceed653f42e695d79f22052c652e, State: Running, Role: LEADER
I20260809 06:32:05.736279 6573 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cbceed653f42e695d79f22052c652e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43021 } }
I20260809 06:32:05.736652 6564 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:05.738903 6575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91cbceed653f42e695d79f22052c652e. Latest consensus state: current_term: 1 leader_uuid: "91cbceed653f42e695d79f22052c652e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cbceed653f42e695d79f22052c652e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43021 } } }
I20260809 06:32:05.739311 6575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:05.739111 6574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91cbceed653f42e695d79f22052c652e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cbceed653f42e695d79f22052c652e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43021 } } }
I20260809 06:32:05.739423 6574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:05.745435 6585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:05.749470 6585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:05.756937 6585 catalog_manager.cc:1347] Generated new cluster ID: 35e9ffd5070642d9a31975dad9940e60
I20260809 06:32:05.757048 6585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:05.786626 6585 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:05.787842 6585 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:05.795998 6585 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91cbceed653f42e695d79f22052c652e: Generated new TSK 0
I20260809 06:32:05.796732 6585 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260809 06:32:05.834432 6612 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260809 06:32:05.834532 6612 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 06:32:05.835726 6568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:05.816377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34012 (local address 127.30.78.126:43021)
0809 06:32:05.816557 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:05.816564 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:05.816951 (+ 387us) server_negotiation.cc:407] Connection header received
0809 06:32:05.817142 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:05.817147 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:05.817235 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:05.817390 (+ 155us) server_negotiation.cc:226] Negotiated authn=JWT
0809 06:32:05.817852 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.818977 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.820243 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.820913 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.821031 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:05.821425 (+ 394us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 06:32:05.835101 (+ 13676us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 06:32:05.835452 (+ 351us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34012: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 06:32:05.835745 6610 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:05.816215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43021 (local address 127.0.0.1:34012)
0809 06:32:05.816854 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:05.816880 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:05.816993 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:05.817384 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:05.817388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:05.817396 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 06:32:05.817658 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:05.817666 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.819097 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.819101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:05.820120 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:05.820131 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:05.821040 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:05.821044 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:05.821171 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:05.821201 (+ 30us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 06:32:05.835289 (+ 14088us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0809 06:32:05.835470 (+ 181us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.78.126:43021: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":372,"threads_started":1}
W20260809 06:32:05.835844 6568 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34012: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42009/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260809 06:32:05.837400 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 6444
I20260809 06:32:05.838474 6559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:05.928496 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 6444
2026-08-09T06:32:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (720 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260809 06:32:05.987987 31033 mini_oidc.cc:152] Starting JWKS server
I20260809 06:32:05.989822 31033 webserver.cc:460] Webserver started at https://127.0.0.1:45753/ using document root <none> and password file <none>
I20260809 06:32:05.990059 31033 mini_oidc.cc:189] Starting OIDC Discovery server
I20260809 06:32:05.990665 31033 webserver.cc:460] Webserver started at http://127.0.0.1:39009/ using document root <none> and password file <none>
2026-08-09T06:32:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:06Z Disabled control of system clock
I20260809 06:32:06.017232 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:39405
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:39525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:39405
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45753/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 06:32:06.325680 6623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:06.325987 6623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:06.326120 6623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:06.332998 6623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:06.333103 6623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:06.333169 6623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:06.333247 6623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:06.333308 6623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 06:32:06.333400 6623 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 06:32:06.333453 6623 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45753/jwks.json
I20260809 06:32:06.342104 6623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:39405
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:39405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45753/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:06.343276 6623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:06.344972 6623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:06.355846 6630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:06.355883 6634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:06.355912 6631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:06.356936 6623 server_base.cc:1034] running on GCE node
I20260809 06:32:06.357626 6623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:06.358944 6623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:06.360140 6623 hybrid_clock.cc:648] HybridClock initialized: now 1786257126360101 us; error 27 us; skew 500 ppm
I20260809 06:32:06.360435 6623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:06.365300 6623 webserver.cc:460] Webserver started at http://127.30.78.126:38881/ using document root <none> and password file <none>
I20260809 06:32:06.365978 6623 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:06.366065 6623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:06.366326 6623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:06.369007 6623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "eeef7eb24003428c9e78ed2fa93484ab"
format_stamp: "Formatted at 2026-08-09 06:32:06 on dist-test-slave-cvwc"
server_key: "01a1b629bdceffad3de602845bb3b399"
server_key_iv: "3d38bb3b61d2cfd2f63994880dda0329"
server_key_version: "encryptionkey@0"
I20260809 06:32:06.369803 6623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "eeef7eb24003428c9e78ed2fa93484ab"
format_stamp: "Formatted at 2026-08-09 06:32:06 on dist-test-slave-cvwc"
server_key: "01a1b629bdceffad3de602845bb3b399"
server_key_iv: "3d38bb3b61d2cfd2f63994880dda0329"
server_key_version: "encryptionkey@0"
I20260809 06:32:06.374532 6623 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:32:06.377604 6642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:06.378818 6623 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 06:32:06.378980 6623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "eeef7eb24003428c9e78ed2fa93484ab"
format_stamp: "Formatted at 2026-08-09 06:32:06 on dist-test-slave-cvwc"
server_key: "01a1b629bdceffad3de602845bb3b399"
server_key_iv: "3d38bb3b61d2cfd2f63994880dda0329"
server_key_version: "encryptionkey@0"
I20260809 06:32:06.379168 6623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:06.396260 6623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:06.396953 6623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:06.397218 6623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:06.413437 6623 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:39405
I20260809 06:32:06.413466 6723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:39405 every 8 connection(s)
I20260809 06:32:06.414583 6623 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:06.417925 6724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:06.421147 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 6623
I20260809 06:32:06.421367 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:06.422174 31033 external_mini_cluster.cc:1428] Setting key 2b8b9c0397e4d58717cc28ae719999b3
I20260809 06:32:06.430025 6724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab: Bootstrap starting.
I20260809 06:32:06.433316 6724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:06.434433 6724 log.cc:824] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:06.434775 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:06.423893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48604 (local address 127.30.78.126:39405)
0809 06:32:06.424755 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:06.424765 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:06.424805 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:32:06.426382 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:06.426402 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:06.426829 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:06.427155 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:06.427682 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:06.428898 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:06.430663 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:06.431289 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:06.431431 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:06.432658 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:06.432666 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:06.432678 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:06.433165 (+ 487us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:06.433258 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:06.433278 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:06.433362 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:06.433581 (+ 219us) server_negotiation.cc:299] Negotiation successful
0809 06:32:06.433912 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":309,"threads_started":1}
I20260809 06:32:06.437331 6724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab: No bootstrap required, opened a new log
I20260809 06:32:06.438438 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:32:06.444742 6724 raft_consensus.cc:348] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeef7eb24003428c9e78ed2fa93484ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39405 } }
I20260809 06:32:06.445055 6724 raft_consensus.cc:374] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:06.445147 6724 raft_consensus.cc:729] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeef7eb24003428c9e78ed2fa93484ab, State: Initialized, Role: FOLLOWER
I20260809 06:32:06.445652 6724 consensus_queue.cc:260] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeef7eb24003428c9e78ed2fa93484ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39405 } }
I20260809 06:32:06.445899 6724 raft_consensus.cc:388] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:06.446028 6724 raft_consensus.cc:482] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:06.446161 6724 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:06.448498 6724 raft_consensus.cc:504] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeef7eb24003428c9e78ed2fa93484ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39405 } }
I20260809 06:32:06.448952 6724 leader_election.cc:302] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eeef7eb24003428c9e78ed2fa93484ab; no voters:
I20260809 06:32:06.449481 6724 leader_election.cc:288] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:06.449606 6730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:06.450268 6730 raft_consensus.cc:686] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [term 1 LEADER]: Becoming Leader. State: Replica: eeef7eb24003428c9e78ed2fa93484ab, State: Running, Role: LEADER
I20260809 06:32:06.450732 6730 consensus_queue.cc:237] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeef7eb24003428c9e78ed2fa93484ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39405 } }
I20260809 06:32:06.451329 6724 sys_catalog.cc:564] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:06.453279 6735 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader eeef7eb24003428c9e78ed2fa93484ab. Latest consensus state: current_term: 1 leader_uuid: "eeef7eb24003428c9e78ed2fa93484ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeef7eb24003428c9e78ed2fa93484ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39405 } } }
I20260809 06:32:06.453665 6735 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:06.454195 6731 sys_catalog.cc:455] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eeef7eb24003428c9e78ed2fa93484ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eeef7eb24003428c9e78ed2fa93484ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39405 } } }
I20260809 06:32:06.454519 6731 sys_catalog.cc:458] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:06.455739 6747 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:06.460348 6747 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:06.468859 6747 catalog_manager.cc:1347] Generated new cluster ID: 065404103ceb44bf8d41ddd94f296c11
I20260809 06:32:06.468950 6747 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:06.508880 6747 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:06.510267 6747 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:06.516716 6747 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eeef7eb24003428c9e78ed2fa93484ab: Generated new TSK 0
I20260809 06:32:06.517565 6747 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:32:06.547398 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:06.539440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48610 (local address 127.30.78.126:39405)
0809 06:32:06.539620 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:06.539627 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:06.540018 (+ 391us) server_negotiation.cc:407] Connection header received
0809 06:32:06.540203 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:06.540209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:06.540293 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:06.540459 (+ 166us) server_negotiation.cc:226] Negotiated authn=JWT
0809 06:32:06.540863 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:06.542002 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:06.543269 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:06.543944 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:06.544064 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:06.544511 (+ 447us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 06:32:06.546763 (+ 2252us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 06:32:06.547077 (+ 314us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48610: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":52}
W20260809 06:32:06.547530 6728 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48610: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260809 06:32:06.549005 6767 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:06.539338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:39405 (local address 127.0.0.1:48610)
0809 06:32:06.539923 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:06.539938 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:06.540053 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:06.540455 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:06.540458 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:06.540465 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0809 06:32:06.540735 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:06.540742 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:06.542117 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:06.542121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:06.543138 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:06.543149 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:06.544102 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:06.544106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:06.544223 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:06.544252 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 06:32:06.546966 (+ 2714us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0809 06:32:06.548605 (+ 1639us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.78.126:39405: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":1375,"thread_start_us":315,"threads_started":1}
I20260809 06:32:06.550007 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 6623
I20260809 06:32:06.551101 6718 generic_service.cc:196] Checking for leaks (request via RPC)
E20260809 06:32:06.559157 6768 webserver.cc:533] Webserver: sslize failed:
E20260809 06:32:06.559242 6768 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260809 06:32:06.644138 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 6623
2026-08-09T06:32:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (715 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-09T06:32:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:06Z Disabled control of system clock
I20260809 06:32:06.729705 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:37277
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:35645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:37277
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/testchainca.cert with env {}
W20260809 06:32:07.038080 6776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:07.038340 6776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:07.038477 6776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:07.045413 6776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:07.045508 6776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:07.045570 6776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:07.045655 6776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:07.045733 6776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260809 06:32:07.045817 6776 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260809 06:32:07.045879 6776 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260809 06:32:07.055614 6776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:35645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:37277
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:37277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:07.056803 6776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:07.058063 6776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:07.068977 6781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:07.068913 6785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:07.068950 6782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:07.069952 6776 server_base.cc:1034] running on GCE node
I20260809 06:32:07.070689 6776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:07.071969 6776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:07.073160 6776 hybrid_clock.cc:648] HybridClock initialized: now 1786257127073112 us; error 42 us; skew 500 ppm
I20260809 06:32:07.073472 6776 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:07.075563 6776 webserver.cc:460] Webserver started at http://127.30.78.126:46111/ using document root <none> and password file <none>
I20260809 06:32:07.076206 6776 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:07.076308 6776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:07.076583 6776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:07.079293 6776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "db150212d966457585f2a6046f26ee4d"
format_stamp: "Formatted at 2026-08-09 06:32:07 on dist-test-slave-cvwc"
server_key: "fcb1156c6b55aced495134cef922d8d4"
server_key_iv: "fde251132938bef9cc79ad5728c692ed"
server_key_version: "encryptionkey@0"
I20260809 06:32:07.080042 6776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "db150212d966457585f2a6046f26ee4d"
format_stamp: "Formatted at 2026-08-09 06:32:07 on dist-test-slave-cvwc"
server_key: "fcb1156c6b55aced495134cef922d8d4"
server_key_iv: "fde251132938bef9cc79ad5728c692ed"
server_key_version: "encryptionkey@0"
I20260809 06:32:07.084692 6776 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260809 06:32:07.087774 6796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:07.088961 6776 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260809 06:32:07.089113 6776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "db150212d966457585f2a6046f26ee4d"
format_stamp: "Formatted at 2026-08-09 06:32:07 on dist-test-slave-cvwc"
server_key: "fcb1156c6b55aced495134cef922d8d4"
server_key_iv: "fde251132938bef9cc79ad5728c692ed"
server_key_version: "encryptionkey@0"
I20260809 06:32:07.089298 6776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:07.105448 6776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:07.106149 6776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:07.106386 6776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:07.122730 6776 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:37277
I20260809 06:32:07.122759 6870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:37277 every 8 connection(s)
I20260809 06:32:07.123880 6776 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:07.125259 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 6776
I20260809 06:32:07.125461 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:07.126302 31033 external_mini_cluster.cc:1428] Setting key d69b3f46417f86c7637b1ee4d308f2fe
I20260809 06:32:07.128085 6871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:07.138806 6876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:07.127990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59264 (local address 127.30.78.126:37277)
0809 06:32:07.128906 (+ 916us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:07.128916 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:07.128957 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:32:07.130479 (+ 1522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:07.130498 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:07.130908 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:07.131221 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:07.131759 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:07.133044 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:07.134800 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:07.135431 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:07.135561 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:07.136696 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:07.136703 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:07.136714 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:07.137226 (+ 512us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:07.137297 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:07.137318 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:07.137415 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:07.137623 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 06:32:07.137933 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":345,"threads_started":1}
I20260809 06:32:07.140127 6871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d: Bootstrap starting.
I20260809 06:32:07.142244 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:32:07.143141 6871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:07.144047 6871 log.cc:824] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:07.146703 6871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d: No bootstrap required, opened a new log
I20260809 06:32:07.153617 6871 raft_consensus.cc:348] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db150212d966457585f2a6046f26ee4d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37277 } }
I20260809 06:32:07.153957 6871 raft_consensus.cc:374] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:07.154048 6871 raft_consensus.cc:729] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db150212d966457585f2a6046f26ee4d, State: Initialized, Role: FOLLOWER
I20260809 06:32:07.154528 6871 consensus_queue.cc:260] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db150212d966457585f2a6046f26ee4d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37277 } }
I20260809 06:32:07.154733 6871 raft_consensus.cc:388] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:07.154851 6871 raft_consensus.cc:482] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:07.155007 6871 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:07.157169 6871 raft_consensus.cc:504] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db150212d966457585f2a6046f26ee4d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37277 } }
I20260809 06:32:07.157616 6871 leader_election.cc:302] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db150212d966457585f2a6046f26ee4d; no voters:
I20260809 06:32:07.158180 6871 leader_election.cc:288] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:07.158288 6878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:07.160008 6878 raft_consensus.cc:686] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [term 1 LEADER]: Becoming Leader. State: Replica: db150212d966457585f2a6046f26ee4d, State: Running, Role: LEADER
I20260809 06:32:07.160183 6871 sys_catalog.cc:564] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:07.160531 6878 consensus_queue.cc:237] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db150212d966457585f2a6046f26ee4d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37277 } }
I20260809 06:32:07.166594 6880 sys_catalog.cc:455] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader db150212d966457585f2a6046f26ee4d. Latest consensus state: current_term: 1 leader_uuid: "db150212d966457585f2a6046f26ee4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db150212d966457585f2a6046f26ee4d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37277 } } }
I20260809 06:32:07.167012 6880 sys_catalog.cc:458] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:07.166339 6879 sys_catalog.cc:455] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db150212d966457585f2a6046f26ee4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db150212d966457585f2a6046f26ee4d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37277 } } }
I20260809 06:32:07.167459 6879 sys_catalog.cc:458] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d [sys.catalog]: This master's current role is: LEADER
W20260809 06:32:07.170522 6896 catalog_manager.cc:1558] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:32:07.170625 6896 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:32:07.170737 6898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:07.172061 6898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:07.179258 6898 catalog_manager.cc:1347] Generated new cluster ID: e0c11829db064d5fb70c432c0853bf84
I20260809 06:32:07.179360 6898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:07.230908 6898 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:07.232193 6898 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:07.237355 6898 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db150212d966457585f2a6046f26ee4d: Generated new TSK 0
I20260809 06:32:07.238353 6898 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:32:07.714674 6876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:07.255197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59280 (local address 127.30.78.126:37277)
0809 06:32:07.255403 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:07.255409 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:07.255710 (+ 301us) server_negotiation.cc:407] Connection header received
0809 06:32:07.255927 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:07.255933 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:07.256021 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:07.256187 (+ 166us) server_negotiation.cc:226] Negotiated authn=JWT
0809 06:32:07.256557 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:07.257673 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:07.259006 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:07.259694 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:07.259812 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:07.260276 (+ 464us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0809 06:32:07.714103 (+453827us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 06:32:07.714450 (+ 347us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59280: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":68}
W20260809 06:32:07.714790 6876 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59280: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260809 06:32:07.714974 6908 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:07.255051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:37277 (local address 127.0.0.1:59280)
0809 06:32:07.255615 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:07.255630 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:07.255753 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:07.256179 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:07.256182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:07.256190 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0809 06:32:07.256419 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:07.256427 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:07.257822 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:07.257826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:07.258865 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:07.258878 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:07.259841 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:07.259845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:07.259989 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:07.260024 (+ 35us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0809 06:32:07.714386 (+454362us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0809 06:32:07.714630 (+ 244us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.78.126:37277: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":281,"threads_started":1}
I20260809 06:32:07.716249 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 6776
I20260809 06:32:07.717290 6863 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:07.816347 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 6776
2026-08-09T06:32:07Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1152 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (393 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (393 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:32:08 dist-test-slave-cvwc krb5kdc[6931](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:32:08 dist-test-slave-cvwc krb5kdc[6931](info): set up 2 sockets
Aug 09 06:32:08 dist-test-slave-cvwc krb5kdc[6931](info): commencing operation
krb5kdc: starting...
W20260809 06:32:09.790457 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.001s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:32:09 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:32:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:32:09.986840 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:40253
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:40253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:10.300654 6949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:10.300926 6949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:10.301056 6949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:10.307976 6949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:10.308080 6949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:10.308153 6949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:10.308228 6949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:10.308286 6949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:10.317503 6949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:40253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:40253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:10.318698 6949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:10.319886 6949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:10.330494 6955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:10.330605 6956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:10.330565 6959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:10.331601 6949 server_base.cc:1034] running on GCE node
I20260809 06:32:10.332293 6949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:10.333508 6949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:10.334702 6949 hybrid_clock.cc:648] HybridClock initialized: now 1786257130334661 us; error 25 us; skew 500 ppm
I20260809 06:32:10.335006 6949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:10 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257130, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:10.337881 6949 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:32:10.339192 6949 webserver.cc:460] Webserver started at http://127.30.78.126:35029/ using document root <none> and password file <none>
I20260809 06:32:10.339787 6949 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:10.339908 6949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:10.340197 6949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:10.343000 6949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "3bd29068b36c440b9091e5144fce5773"
format_stamp: "Formatted at 2026-08-09 06:32:10 on dist-test-slave-cvwc"
server_key: "242cf52d4739ea20581d5b8b30bad32c"
server_key_iv: "14eda1ae525d4cb983e3416793ba3e08"
server_key_version: "encryptionkey@0"
I20260809 06:32:10.343959 6949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "3bd29068b36c440b9091e5144fce5773"
format_stamp: "Formatted at 2026-08-09 06:32:10 on dist-test-slave-cvwc"
server_key: "242cf52d4739ea20581d5b8b30bad32c"
server_key_iv: "14eda1ae525d4cb983e3416793ba3e08"
server_key_version: "encryptionkey@0"
I20260809 06:32:10.349124 6949 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 06:32:10.352495 6969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:10.353701 6949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:32:10.353919 6949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "3bd29068b36c440b9091e5144fce5773"
format_stamp: "Formatted at 2026-08-09 06:32:10 on dist-test-slave-cvwc"
server_key: "242cf52d4739ea20581d5b8b30bad32c"
server_key_iv: "14eda1ae525d4cb983e3416793ba3e08"
server_key_version: "encryptionkey@0"
I20260809 06:32:10.354094 6949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:10.383054 6949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:10.386688 6949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:10.386946 6949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:10.403628 6949 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:40253
I20260809 06:32:10.403687 7048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:40253 every 8 connection(s)
I20260809 06:32:10.404852 6949 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:10.408288 7050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:10.414124 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 6949
I20260809 06:32:10.414350 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:10.415220 31033 external_mini_cluster.cc:1428] Setting key 0e06df076d13c00a723771a11a90f906
I20260809 06:32:10.418968 7050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773: Bootstrap starting.
I20260809 06:32:10.421793 7050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:10.422804 7050 log.cc:824] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:10.425495 7050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773: No bootstrap required, opened a new log
Aug 09 06:32:10 dist-test-slave-cvwc krb5kdc[6931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:10.434355 7050 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd29068b36c440b9091e5144fce5773" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40253 } }
I20260809 06:32:10.434689 7050 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:10.434782 7050 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd29068b36c440b9091e5144fce5773, State: Initialized, Role: FOLLOWER
I20260809 06:32:10.435415 7050 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd29068b36c440b9091e5144fce5773" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40253 } }
I20260809 06:32:10.435719 7050 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:10.435866 7050 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:10.436074 7050 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:10.436966 7053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:10.417258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60666 (local address 127.30.78.126:40253)
0809 06:32:10.417999 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:10.418010 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:10.418048 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:32:10.419755 (+ 1707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:10.419778 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:10.420112 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:10.420460 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:10.421870 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:10.423185 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:10.424763 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:10.425390 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:10.425514 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:10.430054 (+ 4540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:10.430064 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:10.430077 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:10.430119 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:10.433013 (+ 2894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:10.433798 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:10.433804 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:10.433809 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:10.433958 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:10.434336 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:10.434342 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:10.434344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:10.434916 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:10.435211 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:10.435551 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 06:32:10.435911 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":339,"threads_started":1}
I20260809 06:32:10.438482 7050 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd29068b36c440b9091e5144fce5773" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40253 } }
I20260809 06:32:10.439025 7050 leader_election.cc:302] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bd29068b36c440b9091e5144fce5773; no voters:
I20260809 06:32:10.439610 7050 leader_election.cc:288] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:10.439736 7055 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:10.440457 7055 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd29068b36c440b9091e5144fce5773, State: Running, Role: LEADER
I20260809 06:32:10.440958 7055 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd29068b36c440b9091e5144fce5773" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40253 } }
I20260809 06:32:10.441574 7050 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:10.443634 7056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bd29068b36c440b9091e5144fce5773" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd29068b36c440b9091e5144fce5773" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40253 } } }
I20260809 06:32:10.444087 7056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:10.444214 7058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bd29068b36c440b9091e5144fce5773. Latest consensus state: current_term: 1 leader_uuid: "3bd29068b36c440b9091e5144fce5773" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd29068b36c440b9091e5144fce5773" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40253 } } }
I20260809 06:32:10.444545 7058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:10.450268 7066 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:10.455163 7066 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:10.463573 7066 catalog_manager.cc:1347] Generated new cluster ID: b5f8a885056441d5bbab3bf63f355521
I20260809 06:32:10.463688 7066 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:10.478883 7066 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:10.480242 7066 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:10.494395 7066 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3bd29068b36c440b9091e5144fce5773: Generated new TSK 0
I20260809 06:32:10.495108 7066 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:32:10.548906 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40253
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:10.862988 7087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:10.863232 7087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:10.863364 7087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:10.870260 7087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:10.870362 7087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:10.870512 7087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:10.879885 7087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:10.881134 7087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:10.882402 7087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:10.894371 7092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:10.894409 7097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:10.894439 7094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:10.895335 7087 server_base.cc:1034] running on GCE node
I20260809 06:32:10.895871 7087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:10.896677 7087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:10.897873 7087 hybrid_clock.cc:648] HybridClock initialized: now 1786257130897823 us; error 30 us; skew 500 ppm
I20260809 06:32:10.898149 7087 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:10 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257130, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:10.901053 7087 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:32:10.902412 7087 webserver.cc:460] Webserver started at http://127.30.78.65:38543/ using document root <none> and password file <none>
I20260809 06:32:10.903023 7087 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:10.903137 7087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:10.903416 7087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:10.906198 7087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "7c513fdd38e64b8ba17debe2550371d3"
format_stamp: "Formatted at 2026-08-09 06:32:10 on dist-test-slave-cvwc"
server_key: "2703b12def2f842e218d700906adc1f7"
server_key_iv: "539261e44686e36fd1435f8f4fde3b7b"
server_key_version: "encryptionkey@0"
I20260809 06:32:10.906929 7087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "7c513fdd38e64b8ba17debe2550371d3"
format_stamp: "Formatted at 2026-08-09 06:32:10 on dist-test-slave-cvwc"
server_key: "2703b12def2f842e218d700906adc1f7"
server_key_iv: "539261e44686e36fd1435f8f4fde3b7b"
server_key_version: "encryptionkey@0"
I20260809 06:32:10.911553 7087 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:32:10.914619 7109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:10.915812 7087 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:32:10.915963 7087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "7c513fdd38e64b8ba17debe2550371d3"
format_stamp: "Formatted at 2026-08-09 06:32:10 on dist-test-slave-cvwc"
server_key: "2703b12def2f842e218d700906adc1f7"
server_key_iv: "539261e44686e36fd1435f8f4fde3b7b"
server_key_version: "encryptionkey@0"
I20260809 06:32:10.916136 7087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:10.944212 7087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:10.948024 7087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:10.948272 7087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:10.949095 7087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:10.950348 7087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:10.950428 7087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:10.950546 7087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:10.950608 7087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:10.979842 7087 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:38919
I20260809 06:32:10.979879 7284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:38919 every 8 connection(s)
I20260809 06:32:10.981050 7087 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:10.986496 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 7087
I20260809 06:32:10.986698 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:32:10.987514 31033 external_mini_cluster.cc:1428] Setting key 0d299b07c505ae040ba75a232c87ebdd
Aug 09 06:32:10 dist-test-slave-cvwc krb5kdc[6931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257130, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:11.001397 7287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:10.983363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:33637 (local address 127.30.78.126:40253)
0809 06:32:10.983821 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:10.983827 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:10.984761 (+ 934us) server_negotiation.cc:407] Connection header received
0809 06:32:10.986757 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:10.986763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:10.986845 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:10.986947 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:10.988802 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:10.989797 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:10.991882 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:10.992264 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:10.992350 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:10.996113 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:10.996119 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:10.996124 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:10.996161 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:10.998608 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:10.999252 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:10.999258 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:10.999262 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:10.999409 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:10.999768 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:10.999773 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:10.999776 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:11.000113 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:11.000252 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:11.000834 (+ 582us) server_negotiation.cc:299] Negotiation successful
0809 06:32:11.001057 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":211,"threads_started":1}
I20260809 06:32:11.002092 7288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:10.983937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:40253 (local address 127.30.78.65:33637)
0809 06:32:10.984606 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:10.984643 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:10.986470 (+ 1827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:10.987217 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:10.987229 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:10.987928 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:10.988648 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:10.988667 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:10.989933 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:10.989939 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:10.991760 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:10.991774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:10.992471 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:10.992478 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:10.992740 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:10.993364 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:10.993399 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:10.995885 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:10.998754 (+ 2869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:10.998760 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:10.998770 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:10.999145 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:10.999498 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:10.999501 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:10.999503 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:10.999674 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:11.000218 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:11.000223 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:11.000499 (+ 276us) client_negotiation.cc:769] Sending connection context
0809 06:32:11.000703 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 06:32:11.001037 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":263,"threads_started":1}
I20260809 06:32:11.003471 7285 heartbeater.cc:347] Connected to a master server at 127.30.78.126:40253
I20260809 06:32:11.003757 7285 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:11.004552 7285 heartbeater.cc:511] Master 127.30.78.126:40253 requested a full tablet report, sending...
I20260809 06:32:11.006639 6992 ts_manager.cc:194] Registered new tserver with Master: 7c513fdd38e64b8ba17debe2550371d3 (127.30.78.65:38919)
I20260809 06:32:11.007992 6992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:33637
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:32:11.033834 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40253
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:11.339877 7291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:11.340128 7291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:11.340258 7291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:11.347216 7291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:11.347321 7291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:11.347472 7291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:11.356572 7291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:11.357681 7291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:11.358953 7291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:11.370839 7300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:11.370869 7301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:11.371075 7306 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:11.371564 7291 server_base.cc:1034] running on GCE node
I20260809 06:32:11.372116 7291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:11.372972 7291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:11.374150 7291 hybrid_clock.cc:648] HybridClock initialized: now 1786257131374097 us; error 46 us; skew 500 ppm
I20260809 06:32:11.374423 7291 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:11 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257131, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:11.380930 7291 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:32:11.382354 7291 webserver.cc:460] Webserver started at http://127.30.78.66:33197/ using document root <none> and password file <none>
I20260809 06:32:11.382977 7291 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:11.383091 7291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:11.383374 7291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:11.386258 7291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "67e9c0ccc52a417abe46326ffee7a50f"
format_stamp: "Formatted at 2026-08-09 06:32:11 on dist-test-slave-cvwc"
server_key: "0c04339d4fa853ca7cb4a51bf7331dff"
server_key_iv: "98cde2b99919ea50f503ea4875d6708a"
server_key_version: "encryptionkey@0"
I20260809 06:32:11.387043 7291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "67e9c0ccc52a417abe46326ffee7a50f"
format_stamp: "Formatted at 2026-08-09 06:32:11 on dist-test-slave-cvwc"
server_key: "0c04339d4fa853ca7cb4a51bf7331dff"
server_key_iv: "98cde2b99919ea50f503ea4875d6708a"
server_key_version: "encryptionkey@0"
I20260809 06:32:11.391873 7291 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 06:32:11.395017 7316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:11.396188 7291 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:32:11.396332 7291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "67e9c0ccc52a417abe46326ffee7a50f"
format_stamp: "Formatted at 2026-08-09 06:32:11 on dist-test-slave-cvwc"
server_key: "0c04339d4fa853ca7cb4a51bf7331dff"
server_key_iv: "98cde2b99919ea50f503ea4875d6708a"
server_key_version: "encryptionkey@0"
I20260809 06:32:11.396503 7291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:11.411389 7291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:11.415807 7291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:11.416075 7291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:11.417037 7291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:11.418541 7291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:11.418627 7291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:11.418733 7291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:11.418794 7291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:11.448482 7291 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:32987
I20260809 06:32:11.448544 7479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:32987 every 8 connection(s)
I20260809 06:32:11.449622 7291 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:11.458648 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 7291
I20260809 06:32:11.458822 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:32:11.459299 31033 external_mini_cluster.cc:1428] Setting key 262e19b7658279e0569e8f31dd1937d5
Aug 09 06:32:11 dist-test-slave-cvwc krb5kdc[6931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257131, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:11.468385 7287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:11.451852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:39287 (local address 127.30.78.126:40253)
0809 06:32:11.452067 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:11.452073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:11.453185 (+ 1112us) server_negotiation.cc:407] Connection header received
0809 06:32:11.454941 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:11.454945 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:11.455013 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:11.455098 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:11.456456 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.457201 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.459035 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.459451 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.459548 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:11.463071 (+ 3523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:11.463076 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:11.463080 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:11.463110 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:11.465564 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:11.466250 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:11.466254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:11.466256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:11.466384 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:11.466786 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:11.466790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:11.466792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:11.467048 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:11.467189 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:11.467840 (+ 651us) server_negotiation.cc:299] Negotiation successful
0809 06:32:11.468071 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:32:11.469238 7485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:11.452344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:40253 (local address 127.30.78.66:39287)
0809 06:32:11.453027 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:11.453072 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:11.454716 (+ 1644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:11.455291 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:11.455298 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:11.455783 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:11.456313 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:11.456331 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.457322 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.457326 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:11.458893 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:11.458908 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.459661 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.459669 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:11.459922 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:11.460530 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:11.460557 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:11.462877 (+ 2320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:11.465699 (+ 2822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:11.465707 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:11.465742 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:11.466130 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:11.466486 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:11.466491 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:11.466495 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:11.466674 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:11.467169 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:11.467176 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:11.467492 (+ 316us) client_negotiation.cc:769] Sending connection context
0809 06:32:11.467708 (+ 216us) client_negotiation.cc:240] Negotiation successful
0809 06:32:11.468174 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":260,"threads_started":1}
I20260809 06:32:11.470494 7480 heartbeater.cc:347] Connected to a master server at 127.30.78.126:40253
I20260809 06:32:11.470806 7480 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:11.471624 7480 heartbeater.cc:511] Master 127.30.78.126:40253 requested a full tablet report, sending...
I20260809 06:32:11.473129 6992 ts_manager.cc:194] Registered new tserver with Master: 67e9c0ccc52a417abe46326ffee7a50f (127.30.78.66:32987)
I20260809 06:32:11.474151 6992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:39287
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:32:11.504877 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40253
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:11.819455 7489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:11.819706 7489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:11.819846 7489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:11.826722 7489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:11.826833 7489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:11.826989 7489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:11.836061 7489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:11.837186 7489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:11.838431 7489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:11.850632 7497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:11.850579 7498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:11.850664 7500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:11.851404 7489 server_base.cc:1034] running on GCE node
I20260809 06:32:11.851969 7489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:11.852818 7489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:11.854007 7489 hybrid_clock.cc:648] HybridClock initialized: now 1786257131853958 us; error 42 us; skew 500 ppm
I20260809 06:32:11.854295 7489 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:11 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257131, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:11.857311 7489 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:32:11.859119 7489 webserver.cc:460] Webserver started at http://127.30.78.67:46293/ using document root <none> and password file <none>
I20260809 06:32:11.859745 7489 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:11.859865 7489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:11.860160 7489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:11.862978 7489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "3ec9c2054c7b4a1c9e339f2a912d1f45"
format_stamp: "Formatted at 2026-08-09 06:32:11 on dist-test-slave-cvwc"
server_key: "f00498274f198c725115cf14be06034c"
server_key_iv: "f54987d3077a0646f9879d3edf1fef15"
server_key_version: "encryptionkey@0"
I20260809 06:32:11.863719 7489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "3ec9c2054c7b4a1c9e339f2a912d1f45"
format_stamp: "Formatted at 2026-08-09 06:32:11 on dist-test-slave-cvwc"
server_key: "f00498274f198c725115cf14be06034c"
server_key_iv: "f54987d3077a0646f9879d3edf1fef15"
server_key_version: "encryptionkey@0"
I20260809 06:32:11.868468 7489 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:32:11.871865 7508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:11.873045 7489 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:11.873188 7489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "3ec9c2054c7b4a1c9e339f2a912d1f45"
format_stamp: "Formatted at 2026-08-09 06:32:11 on dist-test-slave-cvwc"
server_key: "f00498274f198c725115cf14be06034c"
server_key_iv: "f54987d3077a0646f9879d3edf1fef15"
server_key_version: "encryptionkey@0"
I20260809 06:32:11.873363 7489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:11.893927 7489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:11.897910 7489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:11.898160 7489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:11.899044 7489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:11.900354 7489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:11.900445 7489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:11.900563 7489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:11.900617 7489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:11.930480 7489 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:35935
I20260809 06:32:11.930546 7670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:35935 every 8 connection(s)
I20260809 06:32:11.931636 7489 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:11.940402 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 7489
I20260809 06:32:11.940572 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:32:11.941115 31033 external_mini_cluster.cc:1428] Setting key da2eb20d6533a6587b3fe53e942c2966
Aug 09 06:32:11 dist-test-slave-cvwc krb5kdc[6931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257131, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:11.950253 7287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:11.933958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:51307 (local address 127.30.78.126:40253)
0809 06:32:11.934121 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:11.934126 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:11.935289 (+ 1163us) server_negotiation.cc:407] Connection header received
0809 06:32:11.937077 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:11.937083 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:11.937161 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:11.937251 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:11.938769 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.939508 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.941486 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.941998 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.942104 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:11.945598 (+ 3494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:11.945603 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:11.945606 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:11.945637 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:11.947887 (+ 2250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:11.948507 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:11.948510 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:11.948513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:11.948615 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:11.948930 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:11.948933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:11.948935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:11.949182 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:11.949287 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:11.949845 (+ 558us) server_negotiation.cc:299] Negotiation successful
0809 06:32:11.950013 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 06:32:11.951149 7674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:11.934464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:40253 (local address 127.30.78.67:51307)
0809 06:32:11.935139 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:11.935175 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:11.936804 (+ 1629us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:11.937493 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:11.937501 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:11.938050 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:11.938597 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:11.938616 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.939647 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.939651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:11.941346 (+ 1695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:11.941362 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.942189 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.942194 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:11.942440 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:11.943066 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:11.943087 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:11.945410 (+ 2323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:11.948011 (+ 2601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:11.948017 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:11.948027 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:11.948424 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:11.948687 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:11.948690 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:11.948692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:11.948854 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:11.949268 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:11.949273 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:11.949549 (+ 276us) client_negotiation.cc:769] Sending connection context
0809 06:32:11.949796 (+ 247us) client_negotiation.cc:240] Negotiation successful
0809 06:32:11.950134 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":269,"threads_started":1}
I20260809 06:32:11.952265 7671 heartbeater.cc:347] Connected to a master server at 127.30.78.126:40253
I20260809 06:32:11.952534 7671 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:11.953171 7671 heartbeater.cc:511] Master 127.30.78.126:40253 requested a full tablet report, sending...
I20260809 06:32:11.954556 6992 ts_manager.cc:194] Registered new tserver with Master: 3ec9c2054c7b4a1c9e339f2a912d1f45 (127.30.78.67:35935)
I20260809 06:32:11.955353 6992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:51307
I20260809 06:32:11.956323 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/test-admin.keytab.
Aug 09 06:32:11 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:11.983248 31033 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260809 06:32:11.988261 7679 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:11.986161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48324 (local address 127.30.78.65:38919)
0809 06:32:11.986748 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:11.986755 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:11.986781 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:32:11.986835 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:11.986840 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:11.987029 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:11.987146 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:11.987917 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48324: BlockingRecv error: recv got EOF from 127.0.0.1:48324 (error 108)
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":304,"threads_started":1}
W20260809 06:32:11.988343 31033 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5cc' of type FILE
Aug 09 06:32:11 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:11.990000 31033 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 06:32:11 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:11.991201 31033 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 06:32:11 dist-test-slave-cvwc krb5kdc[6931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:32:12.004899 7679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:11.992743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48332 (local address 127.30.78.65:38919)
0809 06:32:11.992910 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:11.992916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:11.993001 (+ 85us) server_negotiation.cc:407] Connection header received
0809 06:32:11.993175 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:11.993179 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:11.993231 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:11.993310 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:11.994291 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.995215 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.996442 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:11.996968 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:11.997077 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:12.000258 (+ 3181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:12.000288 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:12.000304 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:12.000340 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:12.002772 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.003320 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.003326 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.003328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.003451 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.003709 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.003711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.003713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.004023 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:12.004228 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:12.004460 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 06:32:12.004641 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 06:32:12.010083 7679 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:12.008461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48334 (local address 127.30.78.65:38919)
0809 06:32:12.008635 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:12.008640 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:12.008816 (+ 176us) server_negotiation.cc:407] Connection header received
0809 06:32:12.008965 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:12.008969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:12.009017 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:12.009090 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:12.009894 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48334: BlockingRecv error: recv got EOF from 127.0.0.1:48334 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 06:32:12.010252 31033 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5cc' of type FILE
I20260809 06:32:12.010922 7285 heartbeater.cc:503] Master 127.30.78.126:40253 was elected leader, sending a full tablet report...
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:12.011737 31033 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:12.013051 31033 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[6931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:32:12.025125 7679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:12.014152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48342 (local address 127.30.78.65:38919)
0809 06:32:12.014307 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:12.014313 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:12.014563 (+ 250us) server_negotiation.cc:407] Connection header received
0809 06:32:12.014657 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:12.014660 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:12.014707 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:12.014774 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:12.015572 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.016225 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.017315 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.017769 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.017856 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:12.020953 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:12.020958 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:12.020961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:12.021002 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:12.023228 (+ 2226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.023759 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.023762 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.023764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.023877 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.024150 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.024153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.024155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.024373 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:12.024554 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:12.024721 (+ 167us) server_negotiation.cc:299] Negotiation successful
0809 06:32:12.024854 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260809 06:32:12.028642 7679 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:12.027329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48348 (local address 127.30.78.65:38919)
0809 06:32:12.027465 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:12.027469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:12.027723 (+ 254us) server_negotiation.cc:407] Connection header received
0809 06:32:12.027824 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:12.027827 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:12.027886 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:12.027956 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:12.028455 (+ 499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48348: BlockingRecv error: recv got EOF from 127.0.0.1:48348 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260809 06:32:12.028870 31033 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786257083636440-31033-0/krb5kdc/krb5cc' of type FILE
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:12.030184 31033 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[6931](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:12.031301 31033 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[6931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:32:12.043493 7679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:12.032390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48364 (local address 127.30.78.65:38919)
0809 06:32:12.032564 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:12.032569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:12.032732 (+ 163us) server_negotiation.cc:407] Connection header received
0809 06:32:12.032828 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:12.032831 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:12.032884 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:12.032951 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:12.033770 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.034445 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.035561 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.035955 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.036038 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:12.038953 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:12.038957 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:12.038960 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:12.038986 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:12.041220 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.041813 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.041818 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.041822 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.041971 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.042317 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.042320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.042322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.042552 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:12.042835 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:12.043051 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 06:32:12.043236 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:32:12.044858 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 7087
I20260809 06:32:12.055133 7679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:12.045474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48374 (local address 127.30.78.65:38919)
0809 06:32:12.045591 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:12.045595 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:12.045944 (+ 349us) server_negotiation.cc:407] Connection header received
0809 06:32:12.046045 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:12.046048 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:12.046091 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:12.046158 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:12.046925 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.047557 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.048597 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.048990 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.049072 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:12.050772 (+ 1700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:12.050776 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:12.050779 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:12.050804 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:12.052784 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.053314 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.053318 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.053320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.053478 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.053813 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.053816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.053818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.054061 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:12.054288 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:12.054626 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 06:32:12.054838 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260809 06:32:12.055624 7276 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:12.136926 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 7087
I20260809 06:32:12.158320 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 7291
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[6931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:32:12.172338 7699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:12.159228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55536 (local address 127.30.78.66:32987)
0809 06:32:12.159767 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:12.159774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:12.159798 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:32:12.159861 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:12.159867 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:12.160083 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:12.160210 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:12.161081 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.162150 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.163298 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.163821 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.163920 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:12.167396 (+ 3476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:12.167406 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:12.167419 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:12.167451 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:12.170162 (+ 2711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.170695 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.170702 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.170704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.170813 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.171092 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.171095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.171097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.171405 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:12.171635 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:12.171817 (+ 182us) server_negotiation.cc:299] Negotiation successful
0809 06:32:12.172032 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":279,"threads_started":1}
I20260809 06:32:12.173565 7472 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:12.254171 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 7291
I20260809 06:32:12.275034 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 7489
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[6931](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257132, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:32:12.289898 7701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:12.276012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55094 (local address 127.30.78.67:35935)
0809 06:32:12.276627 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:12.276634 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:12.276662 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:32:12.276724 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:12.276730 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:12.276953 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:12.277098 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:12.278251 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.279260 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.280489 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:12.281045 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:12.281162 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:12.284949 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:12.284960 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:12.284975 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:12.285012 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:12.287670 (+ 2658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.288214 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.288220 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.288222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.288338 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:12.288615 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:12.288617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:12.288619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:12.288924 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:12.289139 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:12.289322 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 06:32:12.289570 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":324,"threads_started":1}
I20260809 06:32:12.291074 7664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:12.372540 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 7489
I20260809 06:32:12.392587 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 6949
I20260809 06:32:12.393700 7041 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:12.494516 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 6949
2026-08-09T06:32:12Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3893 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[7707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[7707](info): set up 2 sockets
Aug 09 06:32:12 dist-test-slave-cvwc krb5kdc[7707](info): commencing operation
krb5kdc: starting...
W20260809 06:32:13.694060 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.004s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:32:13 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:32:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:13Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.126.keytab.
Entry for principal oryx/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.126.keytab.
I20260809 06:32:13.892673 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:32807
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.126.keytab
--principal=oryx/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:32807
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:14.204231 7723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:14.204524 7723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:14.204656 7723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:14.211772 7723 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:14.211899 7723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:14.211982 7723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:14.212066 7723 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:14.212126 7723 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:14.221786 7723 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:32807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.126.keytab
--principal=oryx/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:32807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:14.223042 7723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:14.224306 7723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:14.234969 7733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:14.235031 7738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:14.235059 7735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:14.236053 7723 server_base.cc:1034] running on GCE node
I20260809 06:32:14.236815 7723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:14.238142 7723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:14.239338 7723 hybrid_clock.cc:648] HybridClock initialized: now 1786257134239294 us; error 35 us; skew 500 ppm
I20260809 06:32:14.239652 7723 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:14 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257134, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:14.242542 7723 init.cc:377] Logged in from keytab as oryx/127.30.78.126@KRBTEST.COM (short username oryx)
I20260809 06:32:14.243839 7723 webserver.cc:460] Webserver started at http://127.30.78.126:38575/ using document root <none> and password file <none>
I20260809 06:32:14.244438 7723 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:14.244539 7723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:14.244778 7723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:14.247713 7723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "ab1757cc74244e28b673c196f6a467c7"
format_stamp: "Formatted at 2026-08-09 06:32:14 on dist-test-slave-cvwc"
server_key: "590b8d9e5625ff936a94848603d97d9d"
server_key_iv: "c92812cae608b76c7eb09f704a2ff60c"
server_key_version: "encryptionkey@0"
I20260809 06:32:14.248425 7723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "ab1757cc74244e28b673c196f6a467c7"
format_stamp: "Formatted at 2026-08-09 06:32:14 on dist-test-slave-cvwc"
server_key: "590b8d9e5625ff936a94848603d97d9d"
server_key_iv: "c92812cae608b76c7eb09f704a2ff60c"
server_key_version: "encryptionkey@0"
I20260809 06:32:14.253314 7723 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:32:14.256505 7748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:14.257803 7723 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:32:14.257954 7723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "ab1757cc74244e28b673c196f6a467c7"
format_stamp: "Formatted at 2026-08-09 06:32:14 on dist-test-slave-cvwc"
server_key: "590b8d9e5625ff936a94848603d97d9d"
server_key_iv: "c92812cae608b76c7eb09f704a2ff60c"
server_key_version: "encryptionkey@0"
I20260809 06:32:14.258124 7723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:14.275816 7723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:14.279920 7723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:14.280171 7723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:14.296633 7723 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:32807
I20260809 06:32:14.296654 7829 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:32807 every 8 connection(s)
I20260809 06:32:14.298063 7723 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:14.301554 7830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:14.308074 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 7723
I20260809 06:32:14.308250 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:14.308885 31033 external_mini_cluster.cc:1428] Setting key 7321a7b47c0fd5b940beaeac29f357b7
I20260809 06:32:14.311395 7830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: Bootstrap starting.
I20260809 06:32:14.314529 7830 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:14.315748 7830 log.cc:824] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:14.318761 7830 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: No bootstrap required, opened a new log
Aug 09 06:32:14 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:14.327077 7830 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } }
I20260809 06:32:14.327409 7830 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:14.327503 7830 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab1757cc74244e28b673c196f6a467c7, State: Initialized, Role: FOLLOWER
I20260809 06:32:14.328135 7830 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } }
I20260809 06:32:14.328378 7830 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:14.328505 7830 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:14.328670 7830 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:14.330674 7835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:14.310703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51544 (local address 127.30.78.126:32807)
0809 06:32:14.311399 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:14.311410 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:14.311454 (+ 44us) server_negotiation.cc:407] Connection header received
0809 06:32:14.313107 (+ 1653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:14.313129 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:14.313474 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:14.313807 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:14.315602 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:14.316911 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:14.318621 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:14.319285 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:14.319418 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:14.323705 (+ 4287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:14.323713 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:14.323726 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:14.323772 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:14.326747 (+ 2975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:14.327360 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:14.327367 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:14.327373 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:14.327581 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:14.328012 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:14.328015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:14.328017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:14.328582 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:14.328869 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:14.329252 (+ 383us) server_negotiation.cc:299] Negotiation successful
0809 06:32:14.329610 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":310,"threads_started":1}
I20260809 06:32:14.331305 7830 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } }
I20260809 06:32:14.331745 7830 leader_election.cc:302] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab1757cc74244e28b673c196f6a467c7; no voters:
I20260809 06:32:14.332350 7830 leader_election.cc:288] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:14.332459 7837 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:14.334430 7830 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:14.339282 7837 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 1 LEADER]: Becoming Leader. State: Replica: ab1757cc74244e28b673c196f6a467c7, State: Running, Role: LEADER
I20260809 06:32:14.339895 7837 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } }
I20260809 06:32:14.343072 7840 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab1757cc74244e28b673c196f6a467c7. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } }
I20260809 06:32:14.343055 7838 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } }
I20260809 06:32:14.343480 7840 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:14.343520 7838 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:14.345435 7852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:14.349761 7852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:14.357502 7852 catalog_manager.cc:1347] Generated new cluster ID: c0ac497b1af24904ad9fc2d593958200
I20260809 06:32:14.357605 7852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:14.365588 7852 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:14.367306 7852 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:14.376976 7852 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: Generated new TSK 0
I20260809 06:32:14.377919 7852 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab.
Entry for principal oryx/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab.
I20260809 06:32:14.426388 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:32807
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab
--principal=oryx/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:14.742918 7867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:14.743171 7867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:14.743304 7867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:14.750244 7867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:14.750362 7867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:14.750530 7867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:14.760056 7867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab
--principal=oryx/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:32807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:14.761232 7867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:14.762578 7867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:14.774572 7872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:14.774667 7876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:14.774600 7873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:14.775496 7867 server_base.cc:1034] running on GCE node
I20260809 06:32:14.776098 7867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:14.776942 7867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:14.778131 7867 hybrid_clock.cc:648] HybridClock initialized: now 1786257134778089 us; error 30 us; skew 500 ppm
I20260809 06:32:14.778419 7867 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:14 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257134, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:14.781333 7867 init.cc:377] Logged in from keytab as oryx/127.30.78.65@KRBTEST.COM (short username oryx)
I20260809 06:32:14.782685 7867 webserver.cc:460] Webserver started at http://127.30.78.65:45005/ using document root <none> and password file <none>
I20260809 06:32:14.783406 7867 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:14.783528 7867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:14.783830 7867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:14.786682 7867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "5356d609804e4a30ac579899c0f2986a"
format_stamp: "Formatted at 2026-08-09 06:32:14 on dist-test-slave-cvwc"
server_key: "608765b132679cf4c1466ddb51c6b3fe"
server_key_iv: "efcdf373e19e6a6160040fb9673dd2c7"
server_key_version: "encryptionkey@0"
I20260809 06:32:14.787426 7867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "5356d609804e4a30ac579899c0f2986a"
format_stamp: "Formatted at 2026-08-09 06:32:14 on dist-test-slave-cvwc"
server_key: "608765b132679cf4c1466ddb51c6b3fe"
server_key_iv: "efcdf373e19e6a6160040fb9673dd2c7"
server_key_version: "encryptionkey@0"
I20260809 06:32:14.792146 7867 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:32:14.795295 7887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:14.796448 7867 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:32:14.796581 7867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "5356d609804e4a30ac579899c0f2986a"
format_stamp: "Formatted at 2026-08-09 06:32:14 on dist-test-slave-cvwc"
server_key: "608765b132679cf4c1466ddb51c6b3fe"
server_key_iv: "efcdf373e19e6a6160040fb9673dd2c7"
server_key_version: "encryptionkey@0"
I20260809 06:32:14.796744 7867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:14.814494 7867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:14.818015 7867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:14.818257 7867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:14.819154 7867 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:14.820381 7867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:14.820452 7867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:14.820567 7867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:14.820616 7867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:14.853698 7867 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:46395
I20260809 06:32:14.853763 8055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:46395 every 8 connection(s)
I20260809 06:32:14.854960 7867 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:14.865085 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 7867
I20260809 06:32:14.865263 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:32:14.866051 31033 external_mini_cluster.cc:1428] Setting key 4aad4f9b184db6deeb6c47f17bec99d4
Aug 09 06:32:14 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257134, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:14.873253 8060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:14.857244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:54251 (local address 127.30.78.126:32807)
0809 06:32:14.857646 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:14.857650 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:14.858621 (+ 971us) server_negotiation.cc:407] Connection header received
0809 06:32:14.860342 (+ 1721us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:14.860347 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:14.860430 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:14.860523 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:14.862011 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:14.862760 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:14.864232 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:14.864620 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:14.864748 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:14.868101 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:14.868106 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:14.868109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:14.868139 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:14.870478 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:14.871123 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:14.871127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:14.871130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:14.871239 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:14.871638 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:14.871641 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:14.871643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:14.871906 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:14.872035 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:14.872677 (+ 642us) server_negotiation.cc:299] Negotiation successful
0809 06:32:14.872907 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":195,"threads_started":1}
I20260809 06:32:14.874137 8061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:14.857814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:54251)
0809 06:32:14.858476 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:14.858520 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:14.860091 (+ 1571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:14.860767 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:14.860774 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:14.861283 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:14.861846 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:14.861874 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:14.862913 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:14.862918 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:14.864098 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:14.864111 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:14.864830 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:14.864837 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:14.865069 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:14.865745 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:14.865775 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:14.867904 (+ 2129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:14.870601 (+ 2697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:14.870609 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:14.870624 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:14.871004 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:14.871337 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:14.871342 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:14.871346 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:14.871525 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:14.872025 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:14.872032 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:14.872327 (+ 295us) client_negotiation.cc:769] Sending connection context
0809 06:32:14.872563 (+ 236us) client_negotiation.cc:240] Negotiation successful
0809 06:32:14.873046 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":242,"threads_started":1}
I20260809 06:32:14.875542 8058 heartbeater.cc:347] Connected to a master server at 127.30.78.126:32807
I20260809 06:32:14.875859 8058 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:14.876722 8058 heartbeater.cc:511] Master 127.30.78.126:32807 requested a full tablet report, sending...
I20260809 06:32:14.878772 7780 ts_manager.cc:194] Registered new tserver with Master: 5356d609804e4a30ac579899c0f2986a (127.30.78.65:46395)
I20260809 06:32:14.880218 7780 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:54251
WARNING: no policy specified for oryx/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab.
Entry for principal oryx/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab.
I20260809 06:32:14.912113 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:32807
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab
--principal=oryx/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:15.225787 8066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:15.226040 8066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:15.226172 8066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:15.233184 8066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:15.233280 8066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:15.233429 8066 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:15.242740 8066 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab
--principal=oryx/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:32807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:15.243893 8066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:15.245126 8066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:15.257282 8072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:15.257242 8073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:15.257694 8075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:15.258195 8066 server_base.cc:1034] running on GCE node
I20260809 06:32:15.258797 8066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:15.259645 8066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:15.260845 8066 hybrid_clock.cc:648] HybridClock initialized: now 1786257135260795 us; error 31 us; skew 500 ppm
I20260809 06:32:15.261133 8066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:15 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257135, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:15.264241 8066 init.cc:377] Logged in from keytab as oryx/127.30.78.66@KRBTEST.COM (short username oryx)
I20260809 06:32:15.265581 8066 webserver.cc:460] Webserver started at http://127.30.78.66:42273/ using document root <none> and password file <none>
I20260809 06:32:15.266232 8066 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:15.266340 8066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:15.266626 8066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:15.269335 8066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "a658de280710480b91d583d4d9e854ec"
format_stamp: "Formatted at 2026-08-09 06:32:15 on dist-test-slave-cvwc"
server_key: "0edab778b3f4814396eb399d9af01a64"
server_key_iv: "367b28778ddda5c495cbb9d48ad0d0b2"
server_key_version: "encryptionkey@0"
I20260809 06:32:15.270110 8066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "a658de280710480b91d583d4d9e854ec"
format_stamp: "Formatted at 2026-08-09 06:32:15 on dist-test-slave-cvwc"
server_key: "0edab778b3f4814396eb399d9af01a64"
server_key_iv: "367b28778ddda5c495cbb9d48ad0d0b2"
server_key_version: "encryptionkey@0"
I20260809 06:32:15.274850 8066 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:32:15.278010 8089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:15.279233 8066 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 06:32:15.279373 8066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "a658de280710480b91d583d4d9e854ec"
format_stamp: "Formatted at 2026-08-09 06:32:15 on dist-test-slave-cvwc"
server_key: "0edab778b3f4814396eb399d9af01a64"
server_key_iv: "367b28778ddda5c495cbb9d48ad0d0b2"
server_key_version: "encryptionkey@0"
I20260809 06:32:15.279542 8066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:15.294059 8066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:15.297957 8066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:15.298197 8066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:15.299175 8066 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:15.300460 8066 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:15.300530 8066 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:15.300637 8066 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:15.300688 8066 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:15.330446 8066 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:41201
I20260809 06:32:15.330504 8245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:41201 every 8 connection(s)
I20260809 06:32:15.331612 8066 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:15.339407 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 8066
I20260809 06:32:15.339557 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:32:15.339972 31033 external_mini_cluster.cc:1428] Setting key 24f09d5299deab69bcc113b7b0da304e
Aug 09 06:32:15 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257135, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:15.351861 8060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:15.333839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:50875 (local address 127.30.78.126:32807)
0809 06:32:15.333999 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:15.334003 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:15.335180 (+ 1177us) server_negotiation.cc:407] Connection header received
0809 06:32:15.337220 (+ 2040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:15.337227 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:15.337327 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:15.337429 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:15.339023 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:15.339895 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:15.341983 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:15.342415 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:15.342543 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:15.345989 (+ 3446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:15.345997 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:15.346002 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:15.346041 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:15.348738 (+ 2697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:15.349451 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:15.349455 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:15.349457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:15.349599 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:15.350079 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:15.350083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:15.350086 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:15.350362 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:15.350504 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:15.351230 (+ 726us) server_negotiation.cc:299] Negotiation successful
0809 06:32:15.351476 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:32:15.352720 8249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:15.334303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.66:50875)
0809 06:32:15.335002 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:15.335057 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:15.336913 (+ 1856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:15.337680 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:15.337688 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:15.338257 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:15.338842 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:15.338861 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:15.340055 (+ 1194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:15.340061 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:15.341839 (+ 1778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:15.341853 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:15.342644 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:15.342652 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:15.342905 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:15.343558 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:15.343582 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:15.345759 (+ 2177us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:15.348880 (+ 3121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:15.348889 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:15.348904 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:15.349317 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:15.349738 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:15.349744 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:15.349749 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:15.349953 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:15.350493 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:15.350501 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:15.350826 (+ 325us) client_negotiation.cc:769] Sending connection context
0809 06:32:15.351072 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 06:32:15.351550 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":255,"threads_started":1}
I20260809 06:32:15.354115 8246 heartbeater.cc:347] Connected to a master server at 127.30.78.126:32807
I20260809 06:32:15.354416 8246 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:15.355242 8246 heartbeater.cc:511] Master 127.30.78.126:32807 requested a full tablet report, sending...
I20260809 06:32:15.356724 7780 ts_manager.cc:194] Registered new tserver with Master: a658de280710480b91d583d4d9e854ec (127.30.78.66:41201)
I20260809 06:32:15.357838 7780 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:50875
WARNING: no policy specified for oryx/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab.
Entry for principal oryx/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab.
I20260809 06:32:15.386350 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:32807
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab
--principal=oryx/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:15.719755 8256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:15.720180 8256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:15.720476 8256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:15.728612 8256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:15.728725 8256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:15.728895 8256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:15.738551 8256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab
--principal=oryx/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:32807
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:15.739785 8256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:15.741125 8256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:15.753574 8264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:15.753521 8269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:15.753540 8265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:15.754552 8256 server_base.cc:1034] running on GCE node
I20260809 06:32:15.755136 8256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:15.756050 8256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:15.757262 8256 hybrid_clock.cc:648] HybridClock initialized: now 1786257135757208 us; error 42 us; skew 500 ppm
I20260809 06:32:15.757560 8256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:15 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257135, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:15.760516 8256 init.cc:377] Logged in from keytab as oryx/127.30.78.67@KRBTEST.COM (short username oryx)
I20260809 06:32:15.761920 8256 webserver.cc:460] Webserver started at http://127.30.78.67:37673/ using document root <none> and password file <none>
I20260809 06:32:15.762586 8256 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:15.762706 8256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:15.762988 8256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:15.765811 8256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "cb2e5c5834d44b4380ed75a4409fbe7c"
format_stamp: "Formatted at 2026-08-09 06:32:15 on dist-test-slave-cvwc"
server_key: "dc3e6c51e2a6c4e3a3d8da91ada8a396"
server_key_iv: "5aa9a2a6ce949cfed27b707266159b9e"
server_key_version: "encryptionkey@0"
I20260809 06:32:15.766605 8256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "cb2e5c5834d44b4380ed75a4409fbe7c"
format_stamp: "Formatted at 2026-08-09 06:32:15 on dist-test-slave-cvwc"
server_key: "dc3e6c51e2a6c4e3a3d8da91ada8a396"
server_key_iv: "5aa9a2a6ce949cfed27b707266159b9e"
server_key_version: "encryptionkey@0"
I20260809 06:32:15.771576 8256 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:32:15.774979 8276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:15.776223 8256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:32:15.776378 8256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "cb2e5c5834d44b4380ed75a4409fbe7c"
format_stamp: "Formatted at 2026-08-09 06:32:15 on dist-test-slave-cvwc"
server_key: "dc3e6c51e2a6c4e3a3d8da91ada8a396"
server_key_iv: "5aa9a2a6ce949cfed27b707266159b9e"
server_key_version: "encryptionkey@0"
I20260809 06:32:15.776559 8256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:15.837538 8256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:15.841504 8256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:15.841830 8256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:15.842783 8256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:15.844151 8256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:15.844230 8256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:15.844347 8256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:15.844405 8256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:15.875181 8256 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:42787
I20260809 06:32:15.875218 8445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:42787 every 8 connection(s)
I20260809 06:32:15.876345 8256 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:15.883378 8058 heartbeater.cc:503] Master 127.30.78.126:32807 was elected leader, sending a full tablet report...
I20260809 06:32:15.884428 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 8256
I20260809 06:32:15.884598 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:32:15.885146 31033 external_mini_cluster.cc:1428] Setting key f614467bc88ceec989f2f0bb878289bc
Aug 09 06:32:15 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257135, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:15.895021 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:15.878676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:47221 (local address 127.30.78.126:32807)
0809 06:32:15.879138 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:15.879144 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:15.880079 (+ 935us) server_negotiation.cc:407] Connection header received
0809 06:32:15.881976 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:15.881980 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:15.882046 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:15.882138 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:15.883620 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:15.884745 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:15.886551 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:15.887110 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:15.887247 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:15.890425 (+ 3178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:15.890430 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:15.890434 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:15.890464 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:15.892620 (+ 2156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:15.893246 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:15.893250 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:15.893252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:15.893358 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:15.893688 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:15.893690 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:15.893692 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:15.893972 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:15.894078 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:15.894614 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 06:32:15.894760 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":221,"threads_started":1}
I20260809 06:32:15.895917 8452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:15.879175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.67:47221)
0809 06:32:15.879906 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:15.879959 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:15.881708 (+ 1749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:15.882327 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:15.882335 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:15.882870 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:15.883443 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:15.883464 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:15.884911 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:15.884916 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:15.886409 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:15.886424 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:15.887303 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:15.887308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:15.887511 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:15.888092 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:15.888113 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:15.890236 (+ 2123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:15.892739 (+ 2503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:15.892745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:15.892755 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:15.893156 (+ 401us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:15.893432 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:15.893435 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:15.893437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:15.893608 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:15.894069 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:15.894075 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:15.894347 (+ 272us) client_negotiation.cc:769] Sending connection context
0809 06:32:15.894548 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 06:32:15.894915 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":300,"threads_started":1}
I20260809 06:32:15.897099 8448 heartbeater.cc:347] Connected to a master server at 127.30.78.126:32807
I20260809 06:32:15.897372 8448 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:15.898123 8448 heartbeater.cc:511] Master 127.30.78.126:32807 requested a full tablet report, sending...
I20260809 06:32:15.899569 7780 ts_manager.cc:194] Registered new tserver with Master: cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787)
I20260809 06:32:15.900319 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:32:15.900544 7780 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:47221
WARNING: no policy specified for oryx/127.30.78.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.125.keytab.
Entry for principal oryx/127.30.78.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.125.keytab.
I20260809 06:32:15.944605 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.125:45903
--webserver_interface=127.30.78.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.125.keytab
--principal=oryx/127.30.78.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:32807,127.30.78.125:45903
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:16.261299 8456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:16.261584 8456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:16.261734 8456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:16.268823 8456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:16.268939 8456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:16.269016 8456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:16.269090 8456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:16.269148 8456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:16.278637 8456 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:32807,127.30.78.125:45903
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.125.keytab
--principal=oryx/127.30.78.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.125:45903
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.78.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
W20260809 06:32:16.278972 8456 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.30.78.126:32807,127.30.78.125:45903'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260809 06:32:16.279976 8456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:16.281245 8456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:16.292160 8468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:16.292205 8466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:16.292243 8463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:16.293272 8456 server_base.cc:1034] running on GCE node
I20260809 06:32:16.294052 8456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:16.295331 8456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:16.296546 8456 hybrid_clock.cc:648] HybridClock initialized: now 1786257136296477 us; error 41 us; skew 500 ppm
I20260809 06:32:16.296854 8456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:16 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257136, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:16.299934 8456 init.cc:377] Logged in from keytab as oryx/127.30.78.125@KRBTEST.COM (short username oryx)
I20260809 06:32:16.301368 8456 webserver.cc:460] Webserver started at http://127.30.78.125:37297/ using document root <none> and password file <none>
I20260809 06:32:16.302045 8456 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:16.302136 8456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:16.302443 8456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:16.305207 8456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data/instance:
uuid: "ce2097dfac0447418d867b88a7c9771e"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "f0260724cd726be4db389d373a9aa6dd"
server_key_iv: "63d86531005f49648820d49d24de01a1"
server_key_version: "encryptionkey@0"
I20260809 06:32:16.305994 8456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal/instance:
uuid: "ce2097dfac0447418d867b88a7c9771e"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "f0260724cd726be4db389d373a9aa6dd"
server_key_iv: "63d86531005f49648820d49d24de01a1"
server_key_version: "encryptionkey@0"
I20260809 06:32:16.310698 8456 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 06:32:16.313949 8477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:16.315151 8456 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:32:16.315306 8456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal
uuid: "ce2097dfac0447418d867b88a7c9771e"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "f0260724cd726be4db389d373a9aa6dd"
server_key_iv: "63d86531005f49648820d49d24de01a1"
server_key_version: "encryptionkey@0"
I20260809 06:32:16.315497 8456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:16.339586 8456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:16.343617 8456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:16.343859 8456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:16.360687 8456 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.125:45903
I20260809 06:32:16.360723 8549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.125:45903 every 8 connection(s)
I20260809 06:32:16.360890 8246 heartbeater.cc:503] Master 127.30.78.126:32807 was elected leader, sending a full tablet report...
I20260809 06:32:16.362150 8456 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
I20260809 06:32:16.365761 8550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:16.369863 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 8456
I20260809 06:32:16.372445 8550 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:32:16 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257136, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.125@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
Aug 09 06:32:16 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.125@KRBTEST.COM
I20260809 06:32:16.392912 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.376235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51546 (local address 127.30.78.126:32807)
0809 06:32:16.376431 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:16.376437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:16.376847 (+ 410us) server_negotiation.cc:407] Connection header received
0809 06:32:16.377027 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:16.377033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:16.377107 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:16.377186 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:16.378497 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.379213 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.380807 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.381301 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.381401 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.386665 (+ 5264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:16.386670 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:16.386674 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:16.386711 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:16.389761 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.390643 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.390648 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.390651 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.390798 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.391227 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.391231 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.391234 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.391580 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:16.391713 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:16.392388 (+ 675us) server_negotiation.cc:299] Negotiation successful
0809 06:32:16.392602 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 06:32:16.394155 8554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.376079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:51546)
0809 06:32:16.376717 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:16.376760 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:16.376902 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:16.377275 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:16.377282 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:16.378000 (+ 718us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:16.378346 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.378359 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.379348 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.379353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.380672 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.380687 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.381488 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.381492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.381615 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.383565 (+ 1950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:16.383592 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:16.386458 (+ 2866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:16.389944 (+ 3486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.389957 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.389970 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.390522 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.390912 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.390916 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.390918 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.391120 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.391706 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:16.391714 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:16.392020 (+ 306us) client_negotiation.cc:769] Sending connection context
0809 06:32:16.392266 (+ 246us) client_negotiation.cc:240] Negotiation successful
0809 06:32:16.392705 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":1,"thread_start_us":253,"threads_started":1}
I20260809 06:32:16.394186 8553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.371906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33648 (local address 127.30.78.125:45903)
0809 06:32:16.372650 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:16.372664 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:16.372702 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:32:16.374401 (+ 1699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:16.374423 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:16.374790 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:16.375071 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:16.376770 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.378169 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.379436 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.380119 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.380251 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.388094 (+ 7843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:16.388106 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:16.388121 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:16.388154 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:16.391204 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.391876 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.391883 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.391885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.392023 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.392428 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.392433 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.392437 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.392792 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:16.393095 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:16.393466 (+ 371us) server_negotiation.cc:299] Negotiation successful
0809 06:32:16.393702 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":531,"thread_start_us":303,"threads_started":1}
I20260809 06:32:16.395928 8550 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:32:16 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257136, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.125@KRBTEST.COM for oryx/127.30.78.125@KRBTEST.COM
I20260809 06:32:16.407147 8554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.396819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.0.0.1:33656)
0809 06:32:16.396961 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:16.396980 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:16.397070 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:16.397319 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:16.397322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:16.397605 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:16.397748 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.397759 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.398674 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.398677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.399479 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.399489 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.400234 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.400238 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.400395 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.400821 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:16.400836 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:16.402639 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:16.405266 (+ 2627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.405270 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.405272 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.405607 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.405966 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.405969 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.405971 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.406085 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.406545 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:16.406548 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:16.406660 (+ 112us) client_negotiation.cc:769] Sending connection context
0809 06:32:16.406758 (+ 98us) client_negotiation.cc:240] Negotiation successful
0809 06:32:16.406934 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 06:32:16.407300 8553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.396629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33656 (local address 127.30.78.125:45903)
0809 06:32:16.396775 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:16.396780 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:16.397046 (+ 266us) server_negotiation.cc:407] Connection header received
0809 06:32:16.397161 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:16.397165 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:16.397224 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:16.397303 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:16.397866 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.398554 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.399602 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.400114 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.400224 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.402835 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:16.402840 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:16.402843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:16.402872 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:16.405147 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.405704 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.405707 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.405709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.405875 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.406174 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.406177 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.406179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.406437 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:16.406539 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:16.406838 (+ 299us) server_negotiation.cc:299] Negotiation successful
0809 06:32:16.407050 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":43}
I20260809 06:32:16.411432 8550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Bootstrap starting.
I20260809 06:32:16.414294 8550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:16.415256 8550 log.cc:824] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:16.417548 8550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: No bootstrap required, opened a new log
I20260809 06:32:16.424289 8550 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } }
I20260809 06:32:16.424588 8550 raft_consensus.cc:374] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:16.424675 8550 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce2097dfac0447418d867b88a7c9771e, State: Initialized, Role: FOLLOWER
I20260809 06:32:16.425155 8550 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } }
I20260809 06:32:16.425923 8559 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } } }
I20260809 06:32:16.426215 8559 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:32:16.426800 8550 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: configured and running, proceeding with master startup.
W20260809 06:32:16.435007 8575 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:32:16.435146 8575 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:32:16.436895 8456 master_runner.cc:428] Detected that this master ce2097dfac0447418d867b88a7c9771e is joining an existing cluster
I20260809 06:32:16.436978 8456 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.78.125:45903
I20260809 06:32:16.456197 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.440542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51554 (local address 127.30.78.126:32807)
0809 06:32:16.440708 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:16.440714 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:16.441522 (+ 808us) server_negotiation.cc:407] Connection header received
0809 06:32:16.441807 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:16.441813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:16.441902 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:16.441972 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:16.443481 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.444568 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.446174 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.446603 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.446719 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.449017 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:16.449024 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:16.449029 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:16.449068 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:16.452480 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.453373 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.453389 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.453393 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.453549 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.454448 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.454454 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.454457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.454854 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:16.454977 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:16.455595 (+ 618us) server_negotiation.cc:299] Negotiation successful
0809 06:32:16.455824 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:32:16.457206 8585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.440581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:51554)
0809 06:32:16.441421 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:16.441441 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:16.441624 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:16.442168 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:16.442176 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:16.442906 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:16.443339 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.443352 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.444737 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.444741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.446041 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.446053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.446803 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.446811 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.446978 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.447620 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:16.447643 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:16.448807 (+ 1164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:16.452638 (+ 3831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.452644 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.452647 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.453212 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.454106 (+ 894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.454111 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.454115 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.454282 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.455083 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:16.455088 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:16.455277 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 06:32:16.456451 (+ 1174us) client_negotiation.cc:240] Negotiation successful
0809 06:32:16.456762 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":59,"thread_start_us":405,"threads_started":1}
I20260809 06:32:16.459663 8586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.441157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.0.0.1:33662)
0809 06:32:16.441887 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:16.441900 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:16.442011 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:16.442297 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:16.442301 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:16.442890 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:16.443299 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.443309 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.444722 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.444728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.446482 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.446497 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.447890 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.447896 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.448085 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.448668 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:16.448693 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:16.449964 (+ 1271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:16.453703 (+ 3739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.453707 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.453709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.454174 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.454533 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.454536 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.454539 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.454673 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.458631 (+ 3958us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:16.458635 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:16.458791 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 06:32:16.458951 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 06:32:16.459246 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":74,"thread_start_us":386,"threads_started":1}
I20260809 06:32:16.459798 8553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.440580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33662 (local address 127.30.78.125:45903)
0809 06:32:16.440732 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:16.440737 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:16.441971 (+ 1234us) server_negotiation.cc:407] Connection header received
0809 06:32:16.442122 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:16.442127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:16.442189 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:16.442263 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:16.443431 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.444534 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.446622 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.447202 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.447629 (+ 427us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.450105 (+ 2476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:16.450111 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:16.450114 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:16.450143 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:16.453563 (+ 3420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.454274 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.454278 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.454281 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.454420 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.454764 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.454768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.454771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.458402 (+ 3631us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:16.458565 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:16.459097 (+ 532us) server_negotiation.cc:299] Negotiation successful
0809 06:32:16.459429 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":48}
Aug 09 06:32:16 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257134, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.126@KRBTEST.COM for oryx/127.30.78.125@KRBTEST.COM
WARNING: no policy specified for oryx/127.30.78.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.124@KRBTEST.COM" created.
I20260809 06:32:16.482023 8589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.463962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.0.0.1:33672)
0809 06:32:16.464871 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:16.464918 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:16.465060 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:16.465635 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:16.465642 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:16.466435 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:16.466687 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.466698 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.468063 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.468069 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.469508 (+ 1439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.469522 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.470595 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.470600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.470795 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.471421 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:16.471453 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:16.475302 (+ 3849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:16.479144 (+ 3842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.479157 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.479165 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.479692 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.480100 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.480104 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.480108 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.480269 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.480884 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:16.480893 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:16.481112 (+ 219us) client_negotiation.cc:769] Sending connection context
0809 06:32:16.481295 (+ 183us) client_negotiation.cc:240] Negotiation successful
0809 06:32:16.481600 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"thread_start_us":549,"threads_started":1}
I20260809 06:32:16.482969 8553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.464299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33672 (local address 127.30.78.125:45903)
0809 06:32:16.465240 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:16.465245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:16.465263 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:32:16.465339 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:16.465343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:16.465457 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:16.465554 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:16.466850 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.467917 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.469652 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.470415 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.470543 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.475519 (+ 4976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:16.475526 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:16.475531 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:16.475568 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:16.478980 (+ 3412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.479819 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.479825 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.479828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.479987 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.480389 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.480395 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.480398 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.480751 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:16.480905 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:16.482322 (+ 1417us) server_negotiation.cc:299] Negotiation successful
0809 06:32:16.482557 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":828}
I20260809 06:32:16.484944 7780 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.78.125:45903: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ce2097dfac0447418d867b88a7c9771e"
member_type: NON_VOTER
last_known_addr {
host: "127.30.78.125"
port: 45903
}
attrs {
promote: true
}
}
dest_uuid: "ab1757cc74244e28b673c196f6a467c7"
cas_config_opid_index: -1
I20260809 06:32:16.486138 7780 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } }
I20260809 06:32:16.494891 8593 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ce2097dfac0447418d867b88a7c9771e (127.30.78.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } } }
I20260809 06:32:16.501322 8593 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.78.125:45903
I20260809 06:32:16.501935 8516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:16.502321 8456 master.cc:537] Master@127.30.78.125:45903 shutting down...
I20260809 06:32:16.502635 8596 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } } }
I20260809 06:32:16.502918 8596 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:16.506312 8516 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Refusing update from remote peer ab1757cc74244e28b673c196f6a467c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260809 06:32:16.507612 8596 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 06:32:16.510336 7751 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260809 06:32:16.511803 7751 consensus_peers.cc:487] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 -> Peer ce2097dfac0447418d867b88a7c9771e (127.30.78.125:45903): Couldn't send request to peer ce2097dfac0447418d867b88a7c9771e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.124.keytab.
Entry for principal oryx/127.30.78.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.124.keytab.
I20260809 06:32:16.513875 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.124:36445
--webserver_interface=127.30.78.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.124.keytab
--principal=oryx/127.30.78.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:32807,127.30.78.125:45903,127.30.78.124:36445
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:32:16.517567 8456 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:16.517975 8456 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:16.518164 8456 tablet_replica.cc:330] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: stopping tablet replica
I20260809 06:32:16.525049 8456 master.cc:552] Master@127.30.78.125:45903 shutdown complete.
I20260809 06:32:16.525164 8456 master_runner.cc:305] Clearing existing system tablet
I20260809 06:32:16.525557 8456 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:16.525640 8456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:16.530395 8456 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:32:16.531723 8603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:16.532029 8456 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:16.532275 8456 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260809 06:32:16.532359 8456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal
uuid: "ce2097dfac0447418d867b88a7c9771e"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "f0260724cd726be4db389d373a9aa6dd"
server_key_iv: "63d86531005f49648820d49d24de01a1"
server_key_version: "encryptionkey@0"
I20260809 06:32:16.535769 8456 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:16.540685 8456 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 06:32:16.540838 8456 log.cc:1196] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260809 06:32:16.541235 8456 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Deleting consensus metadata
I20260809 06:32:16.541468 8456 master_runner.cc:315] Copying system tablet from 127.30.78.126:32807
I20260809 06:32:16.547147 8456 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: tablet copy: Beginning tablet copy session from remote peer at address 127.30.78.126:32807
I20260809 06:32:16.559123 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.547811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.30.78.126:32807)
0809 06:32:16.547985 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:16.547992 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:16.548440 (+ 448us) server_negotiation.cc:407] Connection header received
0809 06:32:16.548611 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:16.548617 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:16.548686 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:16.548766 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:16.549675 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.550705 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.551968 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.552419 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.552531 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.554217 (+ 1686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:16.554223 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:16.554226 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:16.554256 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:16.556654 (+ 2398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.557237 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.557242 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.557246 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.557380 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:16.557754 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:16.557759 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:16.557762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:16.558037 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:16.558166 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:16.558579 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 06:32:16.558779 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:32:16.559193 8614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:16.547810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:51558)
0809 06:32:16.548331 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:16.548350 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:16.548490 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:16.548807 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:16.548812 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:16.549206 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:16.549485 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.549499 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.550928 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.550934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.551820 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:16.551831 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:16.552561 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:16.552568 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:16.552746 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:16.553288 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:16.553306 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:16.554039 (+ 733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:16.556778 (+ 2739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.556784 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.556788 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.557131 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.557484 (+ 353us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:16.557489 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:16.557493 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:16.557631 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:16.558149 (+ 518us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:16.558154 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:16.558310 (+ 156us) client_negotiation.cc:769] Sending connection context
0809 06:32:16.558467 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 06:32:16.558745 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":291,"threads_started":1}
I20260809 06:32:16.560186 7810 tablet_copy_service.cc:140] P ab1757cc74244e28b673c196f6a467c7: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ce2097dfac0447418d867b88a7c9771e ({username='oryx', principal='oryx/127.30.78.125@KRBTEST.COM'} at 127.0.0.1:51558)
I20260809 06:32:16.560461 7810 tablet_copy_service.cc:161] P ab1757cc74244e28b673c196f6a467c7: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ce2097dfac0447418d867b88a7c9771e at {username='oryx', principal='oryx/127.30.78.125@KRBTEST.COM'} at 127.0.0.1:51558: session id = ce2097dfac0447418d867b88a7c9771e-00000000000000000000000000000000
I20260809 06:32:16.563650 7810 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 06:32:16.565358 8456 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 06:32:16.569800 8456 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: tablet copy: Starting download of 0 data blocks...
I20260809 06:32:16.570070 8456 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: tablet copy: Starting download of 1 WAL segments...
I20260809 06:32:16.572284 8456 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 06:32:16.575464 7810 tablet_copy_service.cc:342] P ab1757cc74244e28b673c196f6a467c7: Request end of tablet copy session ce2097dfac0447418d867b88a7c9771e-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.78.125@KRBTEST.COM'} at 127.0.0.1:51558
I20260809 06:32:16.575636 7810 tablet_copy_service.cc:433] P ab1757cc74244e28b673c196f6a467c7: ending tablet copy session ce2097dfac0447418d867b88a7c9771e-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ce2097dfac0447418d867b88a7c9771e
I20260809 06:32:16.585989 8456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:16.588243 8617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:16.591055 8618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:16.601444 8620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:16.601500 8456 server_base.cc:1034] running on GCE node
I20260809 06:32:16.601919 8456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:16.602520 8456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:16.603703 8456 hybrid_clock.cc:648] HybridClock initialized: now 1786257136603634 us; error 49 us; skew 500 ppm
I20260809 06:32:16.603904 8456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:16 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257136, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:16.605589 8456 init.cc:377] Logged in from keytab as oryx/127.30.78.125@KRBTEST.COM (short username oryx)
I20260809 06:32:16.610530 8456 webserver.cc:460] Webserver started at http://127.30.78.125:40715/ using document root <none> and password file <none>
I20260809 06:32:16.610814 8456 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:16.610893 8456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:16.613111 8456 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.002s
I20260809 06:32:16.614625 8635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:16.615005 8456 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260809 06:32:16.615131 8456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal
uuid: "ce2097dfac0447418d867b88a7c9771e"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "f0260724cd726be4db389d373a9aa6dd"
server_key_iv: "63d86531005f49648820d49d24de01a1"
server_key_version: "encryptionkey@0"
I20260809 06:32:16.615272 8456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:16.628381 8456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:16.631443 8456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:16.668877 8456 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.125:45903
I20260809 06:32:16.668887 8713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.125:45903 every 8 connection(s)
I20260809 06:32:16.669785 8456 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
I20260809 06:32:16.675472 8714 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:32:16.679286 8714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Bootstrap starting.
I20260809 06:32:16.692022 8714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:32:16.692476 8714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Bootstrap complete.
I20260809 06:32:16.693295 8714 raft_consensus.cc:348] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } }
I20260809 06:32:16.693511 8714 raft_consensus.cc:729] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ce2097dfac0447418d867b88a7c9771e, State: Initialized, Role: LEARNER
I20260809 06:32:16.693745 8714 consensus_queue.cc:260] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } }
I20260809 06:32:16.694523 8718 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } } }
I20260809 06:32:16.694792 8714 sys_catalog.cc:564] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:16.694968 8718 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: This master's current role is: LEARNER
I20260809 06:32:16.703445 8735 catalog_manager.cc:1259] Loaded cluster ID: c0ac497b1af24904ad9fc2d593958200
I20260809 06:32:16.703524 8735 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: loading cluster ID for follower catalog manager: success
I20260809 06:32:16.705741 8735 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: acquiring CA information for follower catalog manager: success
I20260809 06:32:16.707422 8735 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:32:16.902910 8448 heartbeater.cc:503] Master 127.30.78.126:32807 was elected leader, sending a full tablet report...
W20260809 06:32:16.903183 8600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:16.903525 8600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:16.903678 8600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:16.911023 8600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:16.911115 8600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:16.911167 8600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:16.911224 8600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:16.911266 8600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:16.920825 8600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:32807,127.30.78.125:45903,127.30.78.124:36445
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.124.keytab
--principal=oryx/127.30.78.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.124:36445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.78.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:16.922009 8600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:16.923179 8600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:16.933869 8742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:16.933822 8743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:16.934265 8745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:16.934816 8600 server_base.cc:1034] running on GCE node
I20260809 06:32:16.935563 8600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:16.936875 8600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:16.938074 8600 hybrid_clock.cc:648] HybridClock initialized: now 1786257136938022 us; error 38 us; skew 500 ppm
I20260809 06:32:16.938387 8600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:16 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257136, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:16.941468 8600 init.cc:377] Logged in from keytab as oryx/127.30.78.124@KRBTEST.COM (short username oryx)
I20260809 06:32:16.942823 8600 webserver.cc:460] Webserver started at http://127.30.78.124:42693/ using document root <none> and password file <none>
I20260809 06:32:16.943416 8600 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:16.943514 8600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:16.943749 8600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:16.946545 8600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data/instance:
uuid: "c3bfbecaa02c43969783da5c7e610984"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "c61e3db905e82622815766cd45dce3da"
server_key_iv: "6e8ed5b3458c69ca589541da51424ba9"
server_key_version: "encryptionkey@0"
I20260809 06:32:16.947258 8600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal/instance:
uuid: "c3bfbecaa02c43969783da5c7e610984"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "c61e3db905e82622815766cd45dce3da"
server_key_iv: "6e8ed5b3458c69ca589541da51424ba9"
server_key_version: "encryptionkey@0"
I20260809 06:32:16.952162 8600 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260809 06:32:16.955284 8759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:16.956473 8600 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:32:16.956616 8600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal
uuid: "c3bfbecaa02c43969783da5c7e610984"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "c61e3db905e82622815766cd45dce3da"
server_key_iv: "6e8ed5b3458c69ca589541da51424ba9"
server_key_version: "encryptionkey@0"
I20260809 06:32:16.956792 8600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:16.991385 8600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:16.995244 8600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:16.995499 8600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:17.013132 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.005680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33682 (local address 127.30.78.125:45903)
0809 06:32:17.006560 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.006566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.006830 (+ 264us) server_negotiation.cc:407] Connection header received
0809 06:32:17.007068 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.007073 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.007170 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.007289 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:17.007727 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.009098 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.011059 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.012111 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.012248 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.012409 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.012697 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.012805 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":566,"threads_started":1}
I20260809 06:32:17.013139 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.005471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.0.0.1:33682)
0809 06:32:17.006711 (+ 1240us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.006732 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.006911 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.007358 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.007363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.007393 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:17.007585 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.007595 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.009248 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.009254 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.010892 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.010909 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.012323 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.012329 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.012514 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.012576 (+ 62us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.012683 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.012819 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1098,"thread_start_us":995,"threads_started":1}
I20260809 06:32:17.014621 8600 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.124:36445
I20260809 06:32:17.014537 8679 raft_consensus.cc:1203] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260809 06:32:17.014699 8845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.124:36445 every 8 connection(s)
I20260809 06:32:17.015161 8718 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab1757cc74244e28b673c196f6a467c7. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } } }
I20260809 06:32:17.015487 8718 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: This master's current role is: LEARNER
I20260809 06:32:17.016243 8600 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
I20260809 06:32:17.019416 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 8600
I20260809 06:32:17.020623 8846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:17.029861 8846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.124@KRBTEST.COM
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257136, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.124@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:17.042191 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.021535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40378 (local address 127.30.78.124:36445)
0809 06:32:17.022255 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.022266 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.022305 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:32:17.023952 (+ 1647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.023975 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.024362 (+ 387us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.024689 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.026462 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.027781 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.029414 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.030075 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.030199 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.034730 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.034737 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.034746 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.034778 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.038094 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.038740 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.038746 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.038752 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.038919 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.039325 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.039328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.039331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.039846 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.040134 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.040593 (+ 459us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.040966 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":327,"threads_started":1}
I20260809 06:32:17.046253 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.032339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51566 (local address 127.30.78.126:32807)
0809 06:32:17.032498 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.032503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.032984 (+ 481us) server_negotiation.cc:407] Connection header received
0809 06:32:17.033153 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.033157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.033218 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.033295 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.034410 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.035173 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.036735 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.037324 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.037458 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.040630 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.040637 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.040641 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.040678 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.043832 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.044632 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.044638 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.044641 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.044791 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.045120 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.045123 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.045125 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.045376 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.045493 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.045884 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.046035 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 06:32:17.046267 8854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.032249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:51566)
0809 06:32:17.032855 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.032895 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.033045 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.033374 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.033381 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.034025 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.034273 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.034282 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.035319 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.035322 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.036568 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.036597 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.037497 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.037501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.037619 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.038219 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.038235 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.040432 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.043955 (+ 3523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.043964 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.043970 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.044519 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.044901 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.044904 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.044907 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.045024 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.045467 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.045472 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.045599 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.045786 (+ 187us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.046007 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":299,"threads_started":1}
I20260809 06:32:17.047312 8846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257136, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.124@KRBTEST.COM for oryx/127.30.78.125@KRBTEST.COM
I20260809 06:32:17.057812 8854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.047930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.0.0.1:33684)
0809 06:32:17.048095 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.048111 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.048178 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.048410 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.048413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.048684 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.048797 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.048804 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.049667 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.049671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.050562 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.050574 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.051169 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.051173 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.051299 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.051717 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.051731 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.053466 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.056064 (+ 2598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.056067 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.056070 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.056410 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.056693 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.056696 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.056698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.056807 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.057185 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.057188 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.057294 (+ 106us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.057393 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.057576 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 06:32:17.057902 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.048047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33684 (local address 127.30.78.125:45903)
0809 06:32:17.048192 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.048196 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.048211 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:32:17.048255 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.048259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.048313 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.048396 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.048895 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.049564 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.050671 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.051062 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.051147 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.053626 (+ 2479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.053630 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.053633 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.053664 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.055956 (+ 2292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.056492 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.056495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.056498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.056618 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.056876 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.056879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.056881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.057109 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.057210 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.057467 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.057628 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 06:32:17.058805 8846 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257136, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.124@KRBTEST.COM for oryx/127.30.78.124@KRBTEST.COM
I20260809 06:32:17.069975 8854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.059365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:36445 (local address 127.0.0.1:40386)
0809 06:32:17.059514 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.059528 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.059606 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.059887 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.059891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.060212 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.060350 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.060360 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.061352 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.061355 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.062282 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.062294 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.062900 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.062904 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.063029 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.063432 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.063447 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.065293 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.067856 (+ 2563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.067861 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.067865 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.068185 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.068500 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.068504 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.068508 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.068650 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.069100 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.069105 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.069232 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.069338 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.069576 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 06:32:17.070137 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.059548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40386 (local address 127.30.78.124:36445)
0809 06:32:17.059684 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.059689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.059704 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:32:17.059734 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.059737 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.059777 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.059867 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.060488 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.061240 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.062390 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.062772 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.062859 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.065436 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.065441 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.065444 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.065470 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.067745 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.068286 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.068291 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.068294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.068402 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.068744 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.068749 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.068753 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.068996 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.069115 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.069428 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.069786 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":99,"server-negotiator.queue_time_us":43}
I20260809 06:32:17.074460 8846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: Bootstrap starting.
I20260809 06:32:17.077437 8846 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:17.078474 8846 log.cc:824] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:17.080971 8846 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: No bootstrap required, opened a new log
I20260809 06:32:17.087775 8846 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } }
I20260809 06:32:17.088063 8846 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:17.088171 8846 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3bfbecaa02c43969783da5c7e610984, State: Initialized, Role: FOLLOWER
I20260809 06:32:17.088661 8846 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } }
I20260809 06:32:17.089438 8858 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } } }
I20260809 06:32:17.089836 8858 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:32:17.090353 8846 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:17.096946 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 7867
W20260809 06:32:17.099036 8872 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:32:17.099243 8872 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:32:17.103055 8600 master_runner.cc:428] Detected that this master c3bfbecaa02c43969783da5c7e610984 is joining an existing cluster
I20260809 06:32:17.103154 8600 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.78.124:36445
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.65@KRBTEST.COM
I20260809 06:32:17.127645 8874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.098785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42888 (local address 127.30.78.65:46395)
0809 06:32:17.099857 (+ 1072us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.099863 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.099886 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:32:17.099946 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.099952 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.100110 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.100282 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.101896 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.103509 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.105398 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.106266 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.106367 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.112894 (+ 6527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.112910 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.112927 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.112971 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.118449 (+ 5478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.122912 (+ 4463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.122920 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.122925 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.123083 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.123585 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.123590 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.123594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.124030 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.125236 (+ 1206us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.125426 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.125679 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":929,"thread_start_us":754,"threads_started":1}
I20260809 06:32:17.129082 8051 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:17.139554 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.108339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51574 (local address 127.30.78.126:32807)
0809 06:32:17.108609 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.108615 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.115235 (+ 6620us) server_negotiation.cc:407] Connection header received
0809 06:32:17.115306 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.115311 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.115390 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.115486 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.119093 (+ 3607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.120191 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.125821 (+ 5630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.126457 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.126552 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.130639 (+ 4087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.130646 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.130650 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.130691 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.134089 (+ 3398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.135394 (+ 1305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.135400 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.135402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.135546 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.136712 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.136717 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.136720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.137132 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.137273 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.138997 (+ 1724us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.139208 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260809 06:32:17.141052 8807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.108734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33692 (local address 127.30.78.125:45903)
0809 06:32:17.108917 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.108923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.115137 (+ 6214us) server_negotiation.cc:407] Connection header received
0809 06:32:17.115332 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.115337 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.115409 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.115496 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.117132 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.118283 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.120466 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.121146 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.121234 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.123871 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.123878 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.123884 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.123923 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.127969 (+ 4046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.136010 (+ 8041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.136016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.136019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.136168 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.137833 (+ 1665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.137839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.137842 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.138248 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.138380 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.140486 (+ 2106us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.140713 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:32:17.143062 8882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.107779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:51574)
0809 06:32:17.114351 (+ 6572us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.114371 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.114503 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.117033 (+ 2530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.117039 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.117684 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.118917 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.118934 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.120391 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.120396 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.122032 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.122046 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.126822 (+ 4776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.126829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.127009 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.129165 (+ 2156us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.129186 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.130416 (+ 1230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.134302 (+ 3886us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.134307 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.134311 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.134796 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.135689 (+ 893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.135694 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.135697 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.135898 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.137354 (+ 1456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.137359 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.137564 (+ 205us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.140027 (+ 2463us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.142051 (+ 2024us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6399,"thread_start_us":6948,"threads_started":1}
I20260809 06:32:17.144588 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.115852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40402 (local address 127.30.78.124:36445)
0809 06:32:17.116005 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.116010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.129312 (+ 13302us) server_negotiation.cc:407] Connection header received
0809 06:32:17.129499 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.129504 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.129567 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.129640 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.131189 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.132358 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.134282 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.135041 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.135132 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.137537 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.137544 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.137553 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.137585 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.141248 (+ 3663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.142232 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.142237 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.142240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.142384 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.142887 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.142891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.142894 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.143298 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.143462 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.144003 (+ 541us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.144237 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260809 06:32:17.145596 8883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.116043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:36445 (local address 127.0.0.1:40402)
0809 06:32:17.129223 (+ 13180us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.129240 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.129391 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.129838 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.129843 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.130638 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.131040 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.131054 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.132562 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.132567 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.134130 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.134145 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.135419 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.135425 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.135607 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.136229 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.136252 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.137339 (+ 1087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.141425 (+ 4086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.141433 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.141437 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.142085 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.142537 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.142540 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.142543 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.142767 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.143539 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.143543 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.143726 (+ 183us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.144790 (+ 1064us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.145103 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13050,"thread_start_us":12895,"threads_started":1}
I20260809 06:32:17.149135 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.107978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.0.0.1:33692)
0809 06:32:17.115036 (+ 7058us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.115052 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.115210 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.115662 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.115666 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.116552 (+ 886us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.116952 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.116967 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.118483 (+ 1516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.118488 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.120290 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.120307 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.121520 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.121527 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.121732 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.122435 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.122464 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.123644 (+ 1180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.129177 (+ 5533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.129182 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.129186 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.135189 (+ 6003us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.136320 (+ 1131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.136325 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.136328 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.136511 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.138479 (+ 1968us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.138484 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.138687 (+ 203us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.141581 (+ 2894us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.142349 (+ 768us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6933,"thread_start_us":7311,"threads_started":1}
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257134, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.126@KRBTEST.COM for oryx/127.30.78.124@KRBTEST.COM
I20260809 06:32:17.164907 8804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.149351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:36445 (local address 127.0.0.1:40404)
0809 06:32:17.149577 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.149596 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.149695 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.150258 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.150263 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.150697 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.150884 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.150894 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.152411 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.152417 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.153845 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.153860 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.154797 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.154803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.154985 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.155606 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.155629 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.158210 (+ 2581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.162284 (+ 4074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.162289 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.162293 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.162812 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.163223 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.163228 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.163232 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.163414 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.163982 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.163987 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.164161 (+ 174us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.164306 (+ 145us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.164567 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260809 06:32:17.164981 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.149633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40404 (local address 127.30.78.124:36445)
0809 06:32:17.149789 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.149794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.149810 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:32:17.149903 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.149908 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.150099 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.151023 (+ 924us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.151183 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.152259 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.154014 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.154633 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.154744 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.158393 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.158399 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.158404 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.158437 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.162126 (+ 3689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.162949 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.162954 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.162958 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.163111 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.163541 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.163546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.163549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.163859 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.163997 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.164428 (+ 431us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.164632 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 06:32:17.166667 7780 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.78.124:36445: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c3bfbecaa02c43969783da5c7e610984"
member_type: NON_VOTER
last_known_addr {
host: "127.30.78.124"
port: 36445
}
attrs {
promote: true
}
}
dest_uuid: "ab1757cc74244e28b673c196f6a467c7"
cas_config_opid_index: 5
I20260809 06:32:17.167721 7780 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } }
I20260809 06:32:17.170189 8802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:17.173933 8802 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Refusing update from remote peer ab1757cc74244e28b673c196f6a467c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 06:32:17.174106 8596 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c3bfbecaa02c43969783da5c7e610984 (127.30.78.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.174667 8679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 LEARNER]: Refusing update from remote peer ab1757cc74244e28b673c196f6a467c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260809 06:32:17.185968 8887 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260809 06:32:17.194799 8679 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER c3bfbecaa02c43969783da5c7e610984 (127.30.78.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.186424 8596 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.78.124:36445
I20260809 06:32:17.198378 8600 master.cc:537] Master@127.30.78.124:36445 shutting down...
I20260809 06:32:17.199275 8718 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.199545 8718 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: This master's current role is: LEARNER
I20260809 06:32:17.200141 8889 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:17.201524 8886 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: NON_VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: true } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.202375 8886 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:17.202270 8887 raft_consensus.cc:1050] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: attempting to promote NON_VOTER ce2097dfac0447418d867b88a7c9771e to VOTER
I20260809 06:32:17.203541 8887 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } }
I20260809 06:32:17.209580 8679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 LEARNER]: Refusing update from remote peer ab1757cc74244e28b673c196f6a467c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260809 06:32:17.210332 8886 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260809 06:32:17.211069 7751 consensus_peers.cc:487] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 -> Peer c3bfbecaa02c43969783da5c7e610984 (127.30.78.124:36445): Couldn't send request to peer c3bfbecaa02c43969783da5c7e610984. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260809 06:32:17.212666 8889 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ce2097dfac0447418d867b88a7c9771e (127.30.78.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.216372 8889 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.216600 8889 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:17.216861 8889 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.217059 8889 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:17.217796 8679 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ce2097dfac0447418d867b88a7c9771e (127.30.78.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.221925 8718 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.222172 8718 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:32:17.228266 8600 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:17.228695 8600 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:17.228926 8600 tablet_replica.cc:330] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: stopping tablet replica
I20260809 06:32:17.235311 8600 master.cc:552] Master@127.30.78.124:36445 shutdown complete.
I20260809 06:32:17.235395 8600 master_runner.cc:305] Clearing existing system tablet
I20260809 06:32:17.235898 8600 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:17.236028 8600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:17.238878 8600 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:17.240445 8894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:17.240862 8600 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:17.241117 8600 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260809 06:32:17.241235 8600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal
uuid: "c3bfbecaa02c43969783da5c7e610984"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "c61e3db905e82622815766cd45dce3da"
server_key_iv: "6e8ed5b3458c69ca589541da51424ba9"
server_key_version: "encryptionkey@0"
I20260809 06:32:17.246061 8600 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:17.252731 8600 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260809 06:32:17.252892 8600 log.cc:1196] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260809 06:32:17.253307 8600 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: Deleting consensus metadata
I20260809 06:32:17.253531 8600 master_runner.cc:315] Copying system tablet from 127.30.78.126:32807
I20260809 06:32:17.256023 8600 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: tablet copy: Beginning tablet copy session from remote peer at address 127.30.78.126:32807
I20260809 06:32:17.268568 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 7867
I20260809 06:32:17.273206 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.256952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51582 (local address 127.30.78.126:32807)
0809 06:32:17.257170 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.257177 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.258264 (+ 1087us) server_negotiation.cc:407] Connection header received
0809 06:32:17.258445 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.258451 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.258551 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.258668 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.259720 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.260944 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.262761 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.263470 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.263598 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.265905 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.265912 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.265917 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.265958 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.270060 (+ 4102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.270864 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.270869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.270873 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.271035 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.271498 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.271503 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.271506 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.271867 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.271999 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.272591 (+ 592us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.272827 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260809 06:32:17.274279 8909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.256887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:51582)
0809 06:32:17.258136 (+ 1249us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.258154 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.258310 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.258714 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.258719 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.259256 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.259540 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.259553 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.261164 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.261170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.262588 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.262603 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.263634 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.263640 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.263847 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.264554 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.264576 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.265653 (+ 1077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.270216 (+ 4563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.270225 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.270230 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.270725 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.271176 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.271181 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.271185 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.271359 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.272080 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.272084 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.272273 (+ 189us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.273468 (+ 1195us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.273841 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1120,"thread_start_us":985,"threads_started":1}
I20260809 06:32:17.274840 7810 tablet_copy_service.cc:140] P ab1757cc74244e28b673c196f6a467c7: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c3bfbecaa02c43969783da5c7e610984 ({username='oryx', principal='oryx/127.30.78.124@KRBTEST.COM'} at 127.0.0.1:51582)
I20260809 06:32:17.275012 7810 tablet_copy_service.cc:161] P ab1757cc74244e28b673c196f6a467c7: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c3bfbecaa02c43969783da5c7e610984 at {username='oryx', principal='oryx/127.30.78.124@KRBTEST.COM'} at 127.0.0.1:51582: session id = c3bfbecaa02c43969783da5c7e610984-00000000000000000000000000000000
I20260809 06:32:17.278682 7810 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: Tablet Copy: opened 0 blocks and 1 log segments
I20260809 06:32:17.280663 8600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260809 06:32:17.287618 8600 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: tablet copy: Starting download of 0 data blocks...
I20260809 06:32:17.287920 8600 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: tablet copy: Starting download of 1 WAL segments...
I20260809 06:32:17.290436 8600 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260809 06:32:17.291685 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:46395
--local_ip_for_outbound_sockets=127.30.78.65
--tserver_master_addrs=127.30.78.126:32807
--webserver_port=45005
--webserver_interface=127.30.78.65
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab
--principal=oryx/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.78.126:32807,127.30.78.125:45903
--tserver_master_addrs=127.30.78.126:32807,127.30.78.125:45903,127.30.78.124:36445 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:32:17.294734 7810 tablet_copy_service.cc:342] P ab1757cc74244e28b673c196f6a467c7: Request end of tablet copy session c3bfbecaa02c43969783da5c7e610984-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.78.124@KRBTEST.COM'} at 127.0.0.1:51582
I20260809 06:32:17.294869 7810 tablet_copy_service.cc:433] P ab1757cc74244e28b673c196f6a467c7: ending tablet copy session c3bfbecaa02c43969783da5c7e610984-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c3bfbecaa02c43969783da5c7e610984
I20260809 06:32:17.313875 8600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:17.322842 8911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:17.323042 8912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:17.337379 8916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:17.337972 8600 server_base.cc:1034] running on GCE node
I20260809 06:32:17.338348 8600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:17.339023 8600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:17.340211 8600 hybrid_clock.cc:648] HybridClock initialized: now 1786257137340167 us; error 33 us; skew 500 ppm
I20260809 06:32:17.340453 8600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257137, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:17.342621 8600 init.cc:377] Logged in from keytab as oryx/127.30.78.124@KRBTEST.COM (short username oryx)
I20260809 06:32:17.343883 8600 webserver.cc:460] Webserver started at http://127.30.78.124:43983/ using document root <none> and password file <none>
I20260809 06:32:17.344214 8600 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:17.344326 8600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:17.347311 8600 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:32:17.349259 8926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:17.349731 8600 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260809 06:32:17.349900 8600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal
uuid: "c3bfbecaa02c43969783da5c7e610984"
format_stamp: "Formatted at 2026-08-09 06:32:16 on dist-test-slave-cvwc"
server_key: "c61e3db905e82622815766cd45dce3da"
server_key_iv: "6e8ed5b3458c69ca589541da51424ba9"
server_key_version: "encryptionkey@0"
I20260809 06:32:17.350090 8600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:17.368621 8600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:17.372586 8600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:17.406750 8600 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.124:36445
I20260809 06:32:17.406803 9006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.124:36445 every 8 connection(s)
I20260809 06:32:17.407965 8600 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
I20260809 06:32:17.413699 9007 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:32:17.417510 9007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: Bootstrap starting.
I20260809 06:32:17.436550 9007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:32:17.437079 9007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: Bootstrap complete.
I20260809 06:32:17.438205 9007 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } }
I20260809 06:32:17.438510 9007 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c3bfbecaa02c43969783da5c7e610984, State: Initialized, Role: LEARNER
I20260809 06:32:17.438783 9007 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } }
I20260809 06:32:17.439975 9007 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:17.439651 9010 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.440348 9010 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: This master's current role is: LEARNER
I20260809 06:32:17.449172 9028 catalog_manager.cc:1259] Loaded cluster ID: c0ac497b1af24904ad9fc2d593958200
I20260809 06:32:17.449292 9028 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: loading cluster ID for follower catalog manager: success
I20260809 06:32:17.452666 9028 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: acquiring CA information for follower catalog manager: success
I20260809 06:32:17.455026 9028 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260809 06:32:17.662271 8910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:17.662562 8910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:17.662724 8910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:17.670212 8910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:17.670336 8910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:17.670495 8910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:17.680181 8910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab
--principal=oryx/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:46395
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=45005
--tserver_master_addrs=127.30.78.126:32807,127.30.78.125:45903,127.30.78.124:36445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:17.681461 8910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:17.682901 8910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:17.695520 9043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:17.695705 9041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:17.696005 9038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:17.696542 8910 server_base.cc:1034] running on GCE node
I20260809 06:32:17.697088 8910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:17.698005 8910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:17.699193 8910 hybrid_clock.cc:648] HybridClock initialized: now 1786257137699149 us; error 41 us; skew 500 ppm
I20260809 06:32:17.699482 8910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257137, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:17.702440 8910 init.cc:377] Logged in from keytab as oryx/127.30.78.65@KRBTEST.COM (short username oryx)
I20260809 06:32:17.703735 8910 webserver.cc:460] Webserver started at http://127.30.78.65:45005/ using document root <none> and password file <none>
I20260809 06:32:17.704355 8910 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:17.704494 8910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:17.709581 8910 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:32:17.712096 9052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:17.713246 8910 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:17.713395 8910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "5356d609804e4a30ac579899c0f2986a"
format_stamp: "Formatted at 2026-08-09 06:32:14 on dist-test-slave-cvwc"
server_key: "608765b132679cf4c1466ddb51c6b3fe"
server_key_iv: "efcdf373e19e6a6160040fb9673dd2c7"
server_key_version: "encryptionkey@0"
I20260809 06:32:17.714347 8910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:17.734452 8910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:17.738330 8910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:17.738590 8910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:17.739434 8910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:17.740789 8910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:17.740885 8910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:17.740988 8910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:17.741067 8910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:17.771785 8910 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:46395
I20260809 06:32:17.771849 9217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:46395 every 8 connection(s)
I20260809 06:32:17.773149 8910 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:17.776933 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 8910
I20260809 06:32:17.777287 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 8066
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257137, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.125@KRBTEST.COM
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257137, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:17.802548 9225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.775868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:40177 (local address 127.30.78.125:45903)
0809 06:32:17.776563 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.776570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.778867 (+ 2297us) server_negotiation.cc:407] Connection header received
0809 06:32:17.780618 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.780625 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.780729 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.780811 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.783455 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.784703 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.790415 (+ 5712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.791035 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.791160 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.795531 (+ 4371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.795538 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.795543 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.795581 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.798965 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.799823 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.799829 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.799833 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.799980 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.800492 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.800498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.800501 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.800851 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.800987 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.801944 (+ 957us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.802150 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":703,"threads_started":1}
I20260809 06:32:17.804724 9229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.776906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.30.78.65:40177)
0809 06:32:17.778282 (+ 1376us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.778299 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.780449 (+ 2150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.781331 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.781343 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.782339 (+ 996us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.783211 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.783247 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.785902 (+ 2655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.785907 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.788018 (+ 2111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.788035 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.791443 (+ 3408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.791449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.791595 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.792287 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.792315 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.795266 (+ 2951us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.799110 (+ 3844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.799118 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.799131 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.799686 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.800125 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.800130 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.800134 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.800346 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.801082 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.801089 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.801474 (+ 385us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.802820 (+ 1346us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.803317 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1248,"spinlock_wait_cycles":101120,"thread_start_us":1050,"threads_started":1}
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.66@KRBTEST.COM
I20260809 06:32:17.805490 9226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.776190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:49139 (local address 127.30.78.126:32807)
0809 06:32:17.776629 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.776635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.777456 (+ 821us) server_negotiation.cc:407] Connection header received
0809 06:32:17.784048 (+ 6592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.784055 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.784147 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.784254 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.785821 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.786921 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.789861 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.790485 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.790610 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.798661 (+ 8051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.798668 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.798673 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.798732 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.802154 (+ 3422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.802893 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.802898 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.802901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.803045 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.803526 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.803531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.803534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.803899 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.804039 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.804907 (+ 868us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.805137 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":1493,"threads_started":1}
I20260809 06:32:17.806072 9227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.776408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:49139)
0809 06:32:17.777303 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.777351 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.779993 (+ 2642us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.784892 (+ 4899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.784898 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.785389 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.785680 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.785691 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.788189 (+ 2498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.788195 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.789735 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.789749 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.790697 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.790705 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.790969 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.792028 (+ 1059us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.792185 (+ 157us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.798436 (+ 6251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.802299 (+ 3863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.802303 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.802307 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.802743 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.803173 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.803181 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.803184 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.803388 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.804100 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.804105 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.804244 (+ 139us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.804370 (+ 126us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.804624 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":520,"threads_started":1}
I20260809 06:32:17.807111 9221 heartbeater.cc:347] Connected to a master server at 127.30.78.125:45903
I20260809 06:32:17.807171 9219 heartbeater.cc:347] Connected to a master server at 127.30.78.126:32807
I20260809 06:32:17.807399 9221 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:17.807396 9219 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:17.808445 9221 heartbeater.cc:511] Master 127.30.78.125:45903 requested a full tablet report, sending...
I20260809 06:32:17.808503 9219 heartbeater.cc:511] Master 127.30.78.126:32807 requested a full tablet report, sending...
I20260809 06:32:17.810154 7780 ts_manager.cc:194] Re-registered known tserver with Master: 5356d609804e4a30ac579899c0f2986a (127.30.78.65:46395)
I20260809 06:32:17.810853 8661 ts_manager.cc:194] Registered new tserver with Master: 5356d609804e4a30ac579899c0f2986a (127.30.78.65:46395)
I20260809 06:32:17.811250 7780 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:49139
Aug 09 06:32:17 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257137, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.124@KRBTEST.COM
I20260809 06:32:17.814455 9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.778587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60958 (local address 127.30.78.66:41201)
0809 06:32:17.790298 (+ 11711us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.790304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.791742 (+ 1438us) server_negotiation.cc:407] Connection header received
0809 06:32:17.792091 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.792100 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.792350 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.792507 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.794539 (+ 2032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.795962 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.798286 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.800060 (+ 1774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.800180 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.806544 (+ 6364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.806557 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.806572 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.806619 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.811087 (+ 4468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.812047 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.812055 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.812059 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.812220 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.812723 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.812728 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.812731 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.813155 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.813450 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.813802 (+ 352us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.814069 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11576,"thread_start_us":11416,"threads_started":1}
I20260809 06:32:17.815675 8238 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:17.818811 9232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.778366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:36445 (local address 127.30.78.65:51903)
0809 06:32:17.802258 (+ 23892us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.802277 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.802401 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.802996 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.803001 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.803627 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:17.803950 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.803962 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.805819 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.805824 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.808526 (+ 2702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.808542 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.809690 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.809696 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.809893 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.810443 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:17.810463 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:17.812809 (+ 2346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:17.816051 (+ 3242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.816056 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.816058 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.816491 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.816894 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:17.816898 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:17.816901 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:17.817072 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:17.817758 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:17.817763 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:17.817901 (+ 138us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.818026 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.818308 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23776,"thread_start_us":27204,"threads_started":1}
I20260809 06:32:17.818881 9234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.778787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:51903 (local address 127.30.78.124:36445)
0809 06:32:17.801795 (+ 23008us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.801801 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.802514 (+ 713us) server_negotiation.cc:407] Connection header received
0809 06:32:17.802587 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.802592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.802673 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.802760 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:17.804124 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.805466 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.808698 (+ 3232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.809292 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.809426 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.813025 (+ 3599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:17.813031 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:17.813035 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:17.813073 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:17.815910 (+ 2837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.816601 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.816606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.816609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.816761 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:17.817200 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:17.817204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:17.817208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:17.817539 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:17.817679 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.818177 (+ 498us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.818507 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22847,"thread_start_us":23011,"threads_started":1}
I20260809 06:32:17.819687 9218 heartbeater.cc:347] Connected to a master server at 127.30.78.124:36445
I20260809 06:32:17.819803 9218 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:17.820139 9218 heartbeater.cc:511] Master 127.30.78.124:36445 requested a full tablet report, sending...
I20260809 06:32:17.821523 8954 ts_manager.cc:194] Registered new tserver with Master: 5356d609804e4a30ac579899c0f2986a (127.30.78.65:46395)
I20260809 06:32:17.834844 9234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.829688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40418 (local address 127.30.78.124:36445)
0809 06:32:17.829861 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:17.829867 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:17.830206 (+ 339us) server_negotiation.cc:407] Connection header received
0809 06:32:17.830366 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:17.830371 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:17.830460 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:17.830547 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:17.830963 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.831635 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.833119 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.833961 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.834087 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.834297 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:17.834467 (+ 170us) server_negotiation.cc:299] Negotiation successful
0809 06:32:17.834590 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:32:17.834955 9236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:17.829633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:36445 (local address 127.0.0.1:40418)
0809 06:32:17.830115 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:17.830130 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:17.830248 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:17.830581 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:17.830587 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:17.830612 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:17.830831 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.830840 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.831762 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.831767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.832984 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:17.832996 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:17.834135 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:17.834142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:17.834317 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:17.834348 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 06:32:17.834433 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 06:32:17.834563 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":280,"threads_started":1}
I20260809 06:32:17.835803 8970 raft_consensus.cc:1203] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260809 06:32:17.836409 9010 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab1757cc74244e28b673c196f6a467c7. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:17.836671 9010 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: This master's current role is: LEARNER
I20260809 06:32:17.903584 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 8066
I20260809 06:32:17.926820 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:41201
--local_ip_for_outbound_sockets=127.30.78.66
--tserver_master_addrs=127.30.78.126:32807
--webserver_port=42273
--webserver_interface=127.30.78.66
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab
--principal=oryx/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.78.126:32807,127.30.78.125:45903
--tserver_master_addrs=127.30.78.126:32807,127.30.78.125:45903,127.30.78.124:36445 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:18.243419 9238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:18.243683 9238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:18.243788 9238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:18.251094 9238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:18.251196 9238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:18.251312 9238 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:18.260618 9238 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab
--principal=oryx/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:41201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=42273
--tserver_master_addrs=127.30.78.126:32807,127.30.78.125:45903,127.30.78.124:36445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:18.261890 9238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:18.263149 9238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:18.275316 9248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:18.275290 9251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:18.275342 9249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:18.276538 9238 server_base.cc:1034] running on GCE node
I20260809 06:32:18.277124 9238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:18.278005 9238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:18.279193 9238 hybrid_clock.cc:648] HybridClock initialized: now 1786257138279152 us; error 31 us; skew 500 ppm
I20260809 06:32:18.279484 9238 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:18 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257138, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:18.282456 9238 init.cc:377] Logged in from keytab as oryx/127.30.78.66@KRBTEST.COM (short username oryx)
I20260809 06:32:18.283740 9238 webserver.cc:460] Webserver started at http://127.30.78.66:42273/ using document root <none> and password file <none>
I20260809 06:32:18.284395 9238 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:18.284518 9238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:18.286218 9163 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: NON_VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: true } } }
I20260809 06:32:18.286574 9163 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:18.287755 9163 raft_consensus.cc:1050] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: attempting to promote NON_VOTER c3bfbecaa02c43969783da5c7e610984 to VOTER
I20260809 06:32:18.288293 9163 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } }
I20260809 06:32:18.290668 9238 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:32:18.290946 8970 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 LEARNER]: Refusing update from remote peer ab1757cc74244e28b673c196f6a467c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 06:32:18.291024 8679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Refusing update from remote peer ab1757cc74244e28b673c196f6a467c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260809 06:32:18.291620 9262 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 06:32:18.291997 9259 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260809 06:32:18.294000 9267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:18.295715 9238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:32:18.295902 9238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "a658de280710480b91d583d4d9e854ec"
format_stamp: "Formatted at 2026-08-09 06:32:15 on dist-test-slave-cvwc"
server_key: "0edab778b3f4814396eb399d9af01a64"
server_key_iv: "367b28778ddda5c495cbb9d48ad0d0b2"
server_key_version: "encryptionkey@0"
I20260809 06:32:18.297326 9238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:18.303195 9259 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c3bfbecaa02c43969783da5c7e610984 (127.30.78.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:18.303714 8970 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c3bfbecaa02c43969783da5c7e610984 (127.30.78.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:18.307300 9262 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:18.307647 9262 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:18.307936 9010 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:18.308190 9010 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:32:18.308454 9259 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:18.308620 9259 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:18.309438 9262 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:18.309659 9262 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:18.309950 8679 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, c3bfbecaa02c43969783da5c7e610984 (127.30.78.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:18.312686 9277 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab1757cc74244e28b673c196f6a467c7" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:18.312927 9277 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:32:18.322216 9238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:18.325584 9238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:18.325851 9238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:18.326704 9238 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:18.328055 9238 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:18.328151 9238 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:18.328256 9238 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:18.328325 9238 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:18.359367 9238 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:41201
I20260809 06:32:18.359424 9430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:41201 every 8 connection(s)
I20260809 06:32:18.360822 9238 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:18.366438 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 9238
I20260809 06:32:18.366732 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 8256
Aug 09 06:32:18 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.67@KRBTEST.COM
Aug 09 06:32:18 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257138, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.125@KRBTEST.COM
Aug 09 06:32:18 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257138, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.124@KRBTEST.COM
Aug 09 06:32:18 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257138, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:18.389883 9439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.363629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:56093 (local address 127.30.78.124:36445)
0809 06:32:18.364086 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:18.364093 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:18.365491 (+ 1398us) server_negotiation.cc:407] Connection header received
0809 06:32:18.368716 (+ 3225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:18.368722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:18.368813 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:18.368905 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:18.372257 (+ 3352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.373385 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.376109 (+ 2724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.376782 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.376892 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.382794 (+ 5902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:18.382801 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:18.382805 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:18.382844 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:18.386209 (+ 3365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:18.387077 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:18.387083 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:18.387087 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:18.387230 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:18.387782 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:18.387787 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:18.387791 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:18.388148 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:18.388274 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:18.389240 (+ 966us) server_negotiation.cc:299] Negotiation successful
0809 06:32:18.389453 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":212,"threads_started":1}
I20260809 06:32:18.390542 9440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.363671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:58487 (local address 127.30.78.126:32807)
0809 06:32:18.364392 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:18.364396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:18.365508 (+ 1112us) server_negotiation.cc:407] Connection header received
0809 06:32:18.368646 (+ 3138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:18.368654 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:18.368767 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:18.368892 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:18.372804 (+ 3912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.373609 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.378267 (+ 4658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.378914 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.379052 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.383659 (+ 4607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:18.383666 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:18.383671 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:18.383713 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:18.387274 (+ 3561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:18.388278 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:18.388284 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:18.388287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:18.388476 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:18.388940 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:18.388945 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:18.388948 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:18.389269 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:18.389398 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:18.389983 (+ 585us) server_negotiation.cc:299] Negotiation successful
0809 06:32:18.390197 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631,"thread_start_us":537,"threads_started":1}
I20260809 06:32:18.390991 9448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.367975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36314 (local address 127.30.78.67:42787)
0809 06:32:18.370199 (+ 2224us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:18.370204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:18.370225 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:32:18.370276 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:18.370281 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:18.370437 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:18.370566 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:18.372328 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.373822 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.375386 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.375912 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.376032 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.382725 (+ 6693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:18.382740 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:18.382755 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:18.382791 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:18.386697 (+ 3906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:18.387611 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:18.387621 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:18.387624 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:18.387799 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:18.388202 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:18.388217 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:18.388220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:18.388677 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:18.388984 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:18.390289 (+ 1305us) server_negotiation.cc:299] Negotiation successful
0809 06:32:18.390553 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2092,"thread_start_us":1915,"threads_started":1}
I20260809 06:32:18.391618 9445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.366338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:41867 (local address 127.30.78.125:45903)
0809 06:32:18.371187 (+ 4849us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:18.371193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:18.371211 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:32:18.371268 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:18.371272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:18.371343 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:18.371459 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:18.373580 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.374727 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.376551 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.377171 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.377749 (+ 578us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.382261 (+ 4512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:18.382268 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:18.382273 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:18.382313 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:18.387091 (+ 4778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:18.388234 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:18.388240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:18.388243 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:18.388386 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:18.388953 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:18.388958 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:18.388961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:18.389331 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:18.390435 (+ 1104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:18.390564 (+ 129us) server_negotiation.cc:299] Negotiation successful
0809 06:32:18.391021 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4722,"thread_start_us":4555,"threads_started":1}
I20260809 06:32:18.392023 9442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.364326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.66:58487)
0809 06:32:18.365312 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:18.365380 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:18.368477 (+ 3097us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:18.369348 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:18.369358 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:18.371977 (+ 2619us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:18.372664 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.372672 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.373844 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.373850 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.378111 (+ 4261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.378128 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.379844 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.379851 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.380113 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.380676 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:18.380698 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:18.383485 (+ 2787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:18.387410 (+ 3925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:18.387414 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:18.387417 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:18.388153 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:18.388616 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:18.388621 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:18.388624 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:18.388801 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:18.389476 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:18.389480 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:18.389659 (+ 179us) client_negotiation.cc:769] Sending connection context
0809 06:32:18.390774 (+ 1115us) client_negotiation.cc:240] Negotiation successful
0809 06:32:18.391008 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"mutex_wait_us":2555,"spinlock_wait_cycles":99584,"thread_start_us":421,"threads_started":1}
I20260809 06:32:18.392379 8440 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:18.393862 9433 heartbeater.cc:347] Connected to a master server at 127.30.78.126:32807
I20260809 06:32:18.394150 9441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.364326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:36445 (local address 127.30.78.66:56093)
0809 06:32:18.365312 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:18.365375 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:18.368569 (+ 3194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:18.369345 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:18.369357 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:18.370659 (+ 1302us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:18.371373 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.371393 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.373549 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.373555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.375909 (+ 2354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.375926 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.377248 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.377260 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.377582 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.379325 (+ 1743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:18.379350 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:18.382573 (+ 3223us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:18.386370 (+ 3797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:18.386379 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:18.386394 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:18.386936 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:18.387372 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:18.387376 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:18.387379 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:18.387649 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:18.388370 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:18.388378 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:18.388801 (+ 423us) client_negotiation.cc:769] Sending connection context
0809 06:32:18.390133 (+ 1332us) client_negotiation.cc:240] Negotiation successful
0809 06:32:18.390647 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"mutex_wait_us":84,"spinlock_wait_cycles":7040,"thread_start_us":401,"threads_started":1}
I20260809 06:32:18.394253 9433 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:18.395200 9433 heartbeater.cc:511] Master 127.30.78.126:32807 requested a full tablet report, sending...
I20260809 06:32:18.395257 9431 heartbeater.cc:347] Connected to a master server at 127.30.78.124:36445
I20260809 06:32:18.395388 9431 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:18.395814 9431 heartbeater.cc:511] Master 127.30.78.124:36445 requested a full tablet report, sending...
I20260809 06:32:18.393909 9444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.365926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.30.78.66:41867)
0809 06:32:18.367358 (+ 1432us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:18.367383 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:18.368136 (+ 753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:18.371501 (+ 3365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:18.371506 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:18.372084 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:18.372406 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.372416 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.374857 (+ 2441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.374863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.376409 (+ 1546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.376426 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.377407 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.377414 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.377702 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.378657 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:18.378697 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:18.382032 (+ 3335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:18.387254 (+ 5222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:18.387260 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:18.387263 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:18.387845 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:18.388542 (+ 697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:18.388547 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:18.388550 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:18.388793 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:18.389488 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:18.389493 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:18.389687 (+ 194us) client_negotiation.cc:769] Sending connection context
0809 06:32:18.389931 (+ 244us) client_negotiation.cc:240] Negotiation successful
0809 06:32:18.391668 (+ 1737us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1267,"mutex_wait_us":1203,"spinlock_wait_cycles":4480,"thread_start_us":1117,"threads_started":1}
I20260809 06:32:18.397097 8954 ts_manager.cc:194] Registered new tserver with Master: a658de280710480b91d583d4d9e854ec (127.30.78.66:41201)
I20260809 06:32:18.397151 9434 heartbeater.cc:347] Connected to a master server at 127.30.78.125:45903
I20260809 06:32:18.397256 9434 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:18.397266 7780 ts_manager.cc:194] Re-registered known tserver with Master: a658de280710480b91d583d4d9e854ec (127.30.78.66:41201)
I20260809 06:32:18.397608 9434 heartbeater.cc:511] Master 127.30.78.125:45903 requested a full tablet report, sending...
I20260809 06:32:18.398370 7780 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:58487
I20260809 06:32:18.398772 8661 ts_manager.cc:194] Registered new tserver with Master: a658de280710480b91d583d4d9e854ec (127.30.78.66:41201)
I20260809 06:32:18.479179 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 8256
I20260809 06:32:18.503551 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:42787
--local_ip_for_outbound_sockets=127.30.78.67
--tserver_master_addrs=127.30.78.126:32807
--webserver_port=37673
--webserver_interface=127.30.78.67
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab
--principal=oryx/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42441
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.78.126:32807,127.30.78.125:45903
--tserver_master_addrs=127.30.78.126:32807,127.30.78.125:45903,127.30.78.124:36445 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:32:18.813702 9219 heartbeater.cc:503] Master 127.30.78.126:32807 was elected leader, sending a full tablet report...
W20260809 06:32:18.830796 9451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:18.831061 9451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:18.831199 9451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:18.838284 9451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:18.838390 9451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:18.838549 9451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:18.850412 9451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42441
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab
--principal=oryx/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:42787
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=37673
--tserver_master_addrs=127.30.78.126:32807,127.30.78.125:45903,127.30.78.124:36445
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:18.852020 9451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:18.853667 9451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:18.866662 9460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:18.866909 9463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:18.867221 9461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:18.867945 9451 server_base.cc:1034] running on GCE node
I20260809 06:32:18.868580 9451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:18.869479 9451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:18.870682 9451 hybrid_clock.cc:648] HybridClock initialized: now 1786257138870632 us; error 41 us; skew 500 ppm
I20260809 06:32:18.871013 9451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:18 dist-test-slave-cvwc krb5kdc[7707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257138, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:18.874092 9451 init.cc:377] Logged in from keytab as oryx/127.30.78.67@KRBTEST.COM (short username oryx)
I20260809 06:32:18.875463 9451 webserver.cc:460] Webserver started at http://127.30.78.67:37673/ using document root <none> and password file <none>
I20260809 06:32:18.876123 9451 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:18.876255 9451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:18.881412 9451 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:32:18.884001 9474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:18.885253 9451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 06:32:18.885413 9451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "cb2e5c5834d44b4380ed75a4409fbe7c"
format_stamp: "Formatted at 2026-08-09 06:32:15 on dist-test-slave-cvwc"
server_key: "dc3e6c51e2a6c4e3a3d8da91ada8a396"
server_key_iv: "5aa9a2a6ce949cfed27b707266159b9e"
server_key_version: "encryptionkey@0"
I20260809 06:32:18.886404 9451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:18.906497 9451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:18.910326 9451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:18.910567 9451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:18.911432 9451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:18.912716 9451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:18.912811 9451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:18.912921 9451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:18.912999 9451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:18.943810 9451 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:42787
I20260809 06:32:18.943881 9649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:42787 every 8 connection(s)
I20260809 06:32:18.945168 9451 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:18.952968 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 9451
Aug 09 06:32:18 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257138, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
Aug 09 06:32:18 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257138, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.125@KRBTEST.COM
I20260809 06:32:19.006659 9658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.947954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:52379 (local address 127.30.78.125:45903)
0809 06:32:18.960197 (+ 12243us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:18.960205 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:18.960230 (+ 25us) server_negotiation.cc:407] Connection header received
0809 06:32:18.961584 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:18.961590 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:18.961674 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:18.961801 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:18.965358 (+ 3557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.966665 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.975355 (+ 8690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.976052 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.976146 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.997044 (+ 20898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:18.997052 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:18.997058 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:18.997102 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.001009 (+ 3907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.001959 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.001965 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.001968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.002126 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.002739 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.002744 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.002747 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.003101 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.003277 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.005981 (+ 2704us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.006264 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12104,"thread_start_us":12278,"threads_started":1}
I20260809 06:32:19.008378 9659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.948446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.67:42625)
0809 06:32:18.965041 (+ 16595us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:18.965058 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:18.965170 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:18.967920 (+ 2750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:18.967926 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:18.968520 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:18.968821 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.968832 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.972667 (+ 3835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.972672 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.974194 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.974208 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.977245 (+ 3037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.977251 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.977432 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.977979 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:18.978010 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:18.998708 (+ 20698us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:19.004102 (+ 5394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:19.004107 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:19.004111 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:19.004640 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:19.005114 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:19.005119 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:19.005123 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:19.005278 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:19.005971 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:19.005976 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:19.006118 (+ 142us) client_negotiation.cc:769] Sending connection context
0809 06:32:19.006274 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 06:32:19.006800 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16450,"mutex_wait_us":38,"spinlock_wait_cycles":81280,"thread_start_us":12996,"threads_started":1}
Aug 09 06:32:19 dist-test-slave-cvwc krb5kdc[7707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257138, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.124@KRBTEST.COM
I20260809 06:32:19.009655 9656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.947826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:42625 (local address 127.30.78.126:32807)
0809 06:32:18.960624 (+ 12798us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:18.960629 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:18.967423 (+ 6794us) server_negotiation.cc:407] Connection header received
0809 06:32:18.967508 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:18.967514 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:18.967622 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:18.967732 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:18.969006 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.970235 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.974377 (+ 4142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.975031 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.975143 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.000298 (+ 25155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:19.000305 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:19.000309 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:19.000372 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.003936 (+ 3564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.004787 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.004792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.004795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.004978 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.005404 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.005412 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.005416 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.005758 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.005900 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.009070 (+ 3170us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.009289 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12693,"spinlock_wait_cycles":5504,"thread_start_us":12595,"threads_started":1}
I20260809 06:32:19.009687 9660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.948446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.30.78.67:52379)
0809 06:32:18.958596 (+ 10150us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:18.958654 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:18.961183 (+ 2529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:18.962879 (+ 1696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:18.962891 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:18.963635 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:18.964451 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.964480 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.970442 (+ 5962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.970448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.972508 (+ 2060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.972523 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.976496 (+ 3973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.976503 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:18.976787 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:18.993633 (+ 16846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:18.993658 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:18.996795 (+ 3137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:19.001186 (+ 4391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:19.001195 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:19.001213 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:19.001825 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:19.002275 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:19.002280 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:19.002285 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:19.002602 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:19.003398 (+ 796us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:19.003407 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:19.004568 (+ 1161us) client_negotiation.cc:769] Sending connection context
0809 06:32:19.008212 (+ 3644us) client_negotiation.cc:240] Negotiation successful
0809 06:32:19.008520 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9813,"thread_start_us":16188,"threads_started":1}
I20260809 06:32:19.010876 9651 heartbeater.cc:347] Connected to a master server at 127.30.78.126:32807
I20260809 06:32:19.010928 9652 heartbeater.cc:347] Connected to a master server at 127.30.78.125:45903
I20260809 06:32:19.011205 9651 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:19.011201 9652 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:19.012127 9651 heartbeater.cc:511] Master 127.30.78.126:32807 requested a full tablet report, sending...
I20260809 06:32:19.012408 9652 heartbeater.cc:511] Master 127.30.78.125:45903 requested a full tablet report, sending...
I20260809 06:32:19.013851 7780 ts_manager.cc:194] Re-registered known tserver with Master: cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787)
I20260809 06:32:19.014000 8661 ts_manager.cc:194] Registered new tserver with Master: cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787)
I20260809 06:32:19.014981 7780 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:42625
I20260809 06:32:19.016664 9667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.964708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33696 (local address 127.30.78.125:45903)
0809 06:32:18.991074 (+ 26366us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:18.991078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:18.991571 (+ 493us) server_negotiation.cc:407] Connection header received
0809 06:32:18.991715 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:18.991719 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:18.991793 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:18.991912 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:18.993677 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.994606 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.997032 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:18.997694 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:18.997842 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.004056 (+ 6214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:19.004062 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:19.004067 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:19.004103 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.008085 (+ 3982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.010437 (+ 2352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.010442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.010445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.010608 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.011267 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.011273 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.011276 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.011621 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.011836 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.015908 (+ 4072us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.016108 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26262,"thread_start_us":26169,"threads_started":1}
I20260809 06:32:19.018563 9669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.964920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51586 (local address 127.30.78.126:32807)
0809 06:32:18.990184 (+ 25264us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:18.990190 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:18.990211 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:32:18.990270 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:18.990276 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:18.990354 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:18.990484 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:18.999984 (+ 9500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.001178 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.004529 (+ 3351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.005196 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.005315 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.011622 (+ 6307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:19.011629 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:19.011633 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:19.011666 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.015377 (+ 3711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.016139 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.016145 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.016148 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.016356 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.016797 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.016801 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.016804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.017135 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.017343 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.017996 (+ 653us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.018207 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25122,"thread_start_us":25713,"threads_started":1}
I20260809 06:32:19.023895 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.965346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:52827 (local address 127.30.78.124:36445)
0809 06:32:18.995332 (+ 29986us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:18.995338 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:18.995364 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:32:18.995425 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:18.995430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:18.995504 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:18.995619 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:18.996838 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.002713 (+ 5875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.005550 (+ 2837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.006211 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.009118 (+ 2907us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.010635 (+ 1517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:19.010641 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:19.010646 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:19.010683 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.021399 (+ 10716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.022046 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.022052 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.022055 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.022223 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.022624 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.022630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.022633 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.022865 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.022996 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.023364 (+ 368us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.023563 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29857,"thread_start_us":34694,"threads_started":1}
I20260809 06:32:19.023941 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.971338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:36445 (local address 127.30.78.67:52827)
0809 06:32:18.983743 (+ 12405us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:18.983763 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:18.983890 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:18.995653 (+ 11763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:18.995657 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:18.996292 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:18.996671 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:18.996686 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.002864 (+ 6178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.002870 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.004327 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.004341 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.006438 (+ 2097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.006445 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.006628 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.007173 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:19.007194 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:19.010440 (+ 3246us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:19.021524 (+ 11084us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:19.021530 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:19.021534 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:19.021939 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:19.022371 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:19.022376 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:19.022380 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:19.022513 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:19.022993 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:19.022997 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:19.023131 (+ 134us) client_negotiation.cc:769] Sending connection context
0809 06:32:19.023236 (+ 105us) client_negotiation.cc:240] Negotiation successful
0809 06:32:19.023531 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12284,"thread_start_us":12621,"threads_started":1}
I20260809 06:32:19.024233 9670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:18.981491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40430 (local address 127.30.78.124:36445)
0809 06:32:19.000315 (+ 18824us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.000320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.000337 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:32:19.000383 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.000388 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.000453 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.003729 (+ 3276us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:19.003932 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.005697 (+ 1765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.011624 (+ 5927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.012246 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.012365 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.015694 (+ 3329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:19.015701 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:19.015705 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:19.015742 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.020121 (+ 4379us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.020801 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.020807 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.020811 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.020982 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.021998 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.022003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.022006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.022331 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.022562 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.023642 (+ 1080us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.023844 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18705,"thread_start_us":14256,"threads_started":1}
I20260809 06:32:19.025094 9650 heartbeater.cc:347] Connected to a master server at 127.30.78.124:36445
I20260809 06:32:19.025229 9650 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:19.025637 9650 heartbeater.cc:511] Master 127.30.78.124:36445 requested a full tablet report, sending...
I20260809 06:32:19.026721 8951 ts_manager.cc:194] Registered new tserver with Master: cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787)
I20260809 06:32:19.022933 7780 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:32:19.031517 7780 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:32:19.074604 9691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.049132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42896 (local address 127.30.78.65:46395)
0809 06:32:19.064724 (+ 15592us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.064737 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.064796 (+ 59us) server_negotiation.cc:407] Connection header received
0809 06:32:19.064983 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.064993 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.065432 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.066020 (+ 588us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:19.067347 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.068902 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.071837 (+ 2935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.073466 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.073605 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.073852 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.074105 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.074271 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15291,"thread_start_us":13413,"threads_started":1}
I20260809 06:32:19.074625 9689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.048558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:46395 (local address 127.0.0.1:42896)
0809 06:32:19.049153 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:19.049173 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:19.049295 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:19.065974 (+ 16679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:19.065979 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:19.066008 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:19.066460 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.066475 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.069061 (+ 2586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.069066 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.071666 (+ 2600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.071681 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.073667 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.073675 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.073892 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.073935 (+ 43us) client_negotiation.cc:769] Sending connection context
0809 06:32:19.074039 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 06:32:19.074167 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":52,"thread_start_us":747,"threads_started":1}
I20260809 06:32:19.078641 9693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.050024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:42787 (local address 127.0.0.1:36322)
0809 06:32:19.063504 (+ 13480us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:19.063525 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:19.063656 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:19.070010 (+ 6354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:19.070014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:19.070050 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:19.070409 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.070418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.072922 (+ 2504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.072928 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.075174 (+ 2246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.075186 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.077795 (+ 2609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.077805 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.078002 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.078041 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 06:32:19.078145 (+ 104us) client_negotiation.cc:240] Negotiation successful
0809 06:32:19.078289 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13347,"thread_start_us":13720,"threads_started":1}
I20260809 06:32:19.078354 9117 tablet_service.cc:1467] Processing CreateTablet for tablet 36daf2175044481ca3ea1b9982d8d7de (DEFAULT_TABLE table=test-table [id=dff55014981e477ebbb5faf9f93573b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:19.079380 9694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.050289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36322 (local address 127.30.78.67:42787)
0809 06:32:19.069219 (+ 18930us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.069228 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.069264 (+ 36us) server_negotiation.cc:407] Connection header received
0809 06:32:19.069359 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.069367 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.069598 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.069978 (+ 380us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:19.070590 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.072071 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.075307 (+ 3236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.077235 (+ 1928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.077386 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.077617 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.078890 (+ 1273us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.079054 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16235,"thread_start_us":16303,"threads_started":1}
I20260809 06:32:19.079547 9690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.048962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41201 (local address 127.0.0.1:60970)
0809 06:32:19.049779 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:19.049797 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:19.049916 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:19.067077 (+ 17161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:19.067081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:19.067106 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:19.067491 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.067503 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.069273 (+ 1770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.069279 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.074055 (+ 4776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.074068 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.078772 (+ 4704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.078779 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.078939 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.078971 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:32:19.079038 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 06:32:19.079162 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":2815,"thread_start_us":659,"threads_started":1}
I20260809 06:32:19.079958 9117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36daf2175044481ca3ea1b9982d8d7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:19.080456 9692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.049501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60970 (local address 127.30.78.66:41201)
0809 06:32:19.066013 (+ 16512us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.066023 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.066053 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:32:19.066151 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.066159 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.066435 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.067082 (+ 647us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:19.067659 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.069106 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.074210 (+ 5104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.078526 (+ 4316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.079757 (+ 1231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.079953 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.080021 (+ 68us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.080176 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16319,"thread_start_us":17275,"threads_started":1}
I20260809 06:32:19.084511 9334 tablet_service.cc:1467] Processing CreateTablet for tablet 36daf2175044481ca3ea1b9982d8d7de (DEFAULT_TABLE table=test-table [id=dff55014981e477ebbb5faf9f93573b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:19.084511 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 36daf2175044481ca3ea1b9982d8d7de (DEFAULT_TABLE table=test-table [id=dff55014981e477ebbb5faf9f93573b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:19.085920 9334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36daf2175044481ca3ea1b9982d8d7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:19.086635 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 36daf2175044481ca3ea1b9982d8d7de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:19.101183 9697 tablet_bootstrap.cc:492] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: Bootstrap starting.
I20260809 06:32:19.103045 9698 tablet_bootstrap.cc:492] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: Bootstrap starting.
I20260809 06:32:19.103825 9699 tablet_bootstrap.cc:492] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: Bootstrap starting.
I20260809 06:32:19.104992 9697 tablet_bootstrap.cc:654] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:19.106093 9697 log.cc:824] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:19.107872 9699 tablet_bootstrap.cc:654] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:19.107872 9698 tablet_bootstrap.cc:654] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:19.109045 9699 log.cc:824] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:19.109045 9698 log.cc:824] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:19.112092 9697 tablet_bootstrap.cc:492] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: No bootstrap required, opened a new log
I20260809 06:32:19.112377 9697 ts_tablet_manager.cc:1397] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260809 06:32:19.112574 9698 tablet_bootstrap.cc:492] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: No bootstrap required, opened a new log
I20260809 06:32:19.112574 9699 tablet_bootstrap.cc:492] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: No bootstrap required, opened a new log
I20260809 06:32:19.112816 9698 ts_tablet_manager.cc:1397] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260809 06:32:19.112815 9699 ts_tablet_manager.cc:1397] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260809 06:32:19.123086 9699 raft_consensus.cc:348] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } }
I20260809 06:32:19.123538 9699 raft_consensus.cc:374] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:19.123646 9699 raft_consensus.cc:729] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb2e5c5834d44b4380ed75a4409fbe7c, State: Initialized, Role: FOLLOWER
I20260809 06:32:19.123791 9698 raft_consensus.cc:348] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } }
I20260809 06:32:19.124213 9698 raft_consensus.cc:374] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:19.124313 9698 raft_consensus.cc:729] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a658de280710480b91d583d4d9e854ec, State: Initialized, Role: FOLLOWER
I20260809 06:32:19.123958 9697 raft_consensus.cc:348] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } }
I20260809 06:32:19.124413 9699 consensus_queue.cc:260] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } }
I20260809 06:32:19.124650 9697 raft_consensus.cc:374] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:19.124883 9697 raft_consensus.cc:729] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5356d609804e4a30ac579899c0f2986a, State: Initialized, Role: FOLLOWER
I20260809 06:32:19.125032 9698 consensus_queue.cc:260] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } }
I20260809 06:32:19.125684 9651 heartbeater.cc:503] Master 127.30.78.126:32807 was elected leader, sending a full tablet report...
I20260809 06:32:19.127475 9697 consensus_queue.cc:260] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } }
I20260809 06:32:19.131086 9699 ts_tablet_manager.cc:1428] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: Time spent starting tablet: real 0.018s user 0.009s sys 0.005s
I20260809 06:32:19.135257 9698 ts_tablet_manager.cc:1428] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: Time spent starting tablet: real 0.022s user 0.013s sys 0.005s
I20260809 06:32:19.135511 9433 heartbeater.cc:503] Master 127.30.78.126:32807 was elected leader, sending a full tablet report...
I20260809 06:32:19.138408 9697 ts_tablet_manager.cc:1428] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: Time spent starting tablet: real 0.026s user 0.014s sys 0.004s
W20260809 06:32:19.197949 9655 tablet.cc:2369] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:32:19.240327 9708 raft_consensus.cc:482] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:19.240698 9708 raft_consensus.cc:504] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } }
I20260809 06:32:19.242594 9708 leader_election.cc:288] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5356d609804e4a30ac579899c0f2986a (127.30.78.65:46395), cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787)
I20260809 06:32:19.249541 9694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.243115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:60167 (local address 127.30.78.67:42787)
0809 06:32:19.243314 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.243321 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.244200 (+ 879us) server_negotiation.cc:407] Connection header received
0809 06:32:19.244467 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.244472 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.244552 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.244604 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:19.245269 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.246084 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.247917 (+ 1833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.248661 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.248792 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.248867 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.249181 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.249301 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:32:19.249560 9691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.242919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:38657 (local address 127.30.78.65:46395)
0809 06:32:19.243114 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.243122 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.244494 (+ 1372us) server_negotiation.cc:407] Connection header received
0809 06:32:19.244653 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.244658 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.244714 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.244787 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:19.245365 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.246115 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.247920 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.248690 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.248844 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.248916 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.249186 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.249308 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:32:19.249739 9710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.242881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:42787 (local address 127.30.78.66:60167)
0809 06:32:19.243910 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:19.243932 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:19.244267 (+ 335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:19.244773 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:19.244776 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:19.244797 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:19.245115 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.245123 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.246231 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.246236 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.247748 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.247761 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.248866 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.248873 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.249029 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.249053 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:32:19.249131 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 06:32:19.249247 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"mutex_wait_us":23,"thread_start_us":576,"threads_started":1}
I20260809 06:32:19.249771 9712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.242940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:46395 (local address 127.30.78.66:38657)
0809 06:32:19.244236 (+ 1296us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:19.244254 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:19.244533 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:19.244814 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:19.244818 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:19.244847 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:19.245201 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.245214 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.246253 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.246257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.247754 (+ 1497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:19.247767 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.248918 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.248925 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:19.249038 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.249063 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 06:32:19.249144 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 06:32:19.249260 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1181,"mutex_wait_us":22,"thread_start_us":1009,"threads_started":1}
I20260809 06:32:19.250686 9581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36daf2175044481ca3ea1b9982d8d7de" candidate_uuid: "a658de280710480b91d583d4d9e854ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" is_pre_election: true
I20260809 06:32:19.250785 9150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36daf2175044481ca3ea1b9982d8d7de" candidate_uuid: "a658de280710480b91d583d4d9e854ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5356d609804e4a30ac579899c0f2986a" is_pre_election: true
I20260809 06:32:19.251183 9581 raft_consensus.cc:2454] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a658de280710480b91d583d4d9e854ec in term 0.
I20260809 06:32:19.251237 9150 raft_consensus.cc:2454] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a658de280710480b91d583d4d9e854ec in term 0.
I20260809 06:32:19.251789 9273 leader_election.cc:302] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a658de280710480b91d583d4d9e854ec, cb2e5c5834d44b4380ed75a4409fbe7c; no voters:
I20260809 06:32:19.252151 9708 raft_consensus.cc:2781] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:32:19.252310 9708 raft_consensus.cc:482] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:19.252414 9708 raft_consensus.cc:3037] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:19.254819 9708 raft_consensus.cc:504] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } }
I20260809 06:32:19.255332 9708 leader_election.cc:288] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [CANDIDATE]: Term 1 election: Requested vote from peers 5356d609804e4a30ac579899c0f2986a (127.30.78.65:46395), cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787)
I20260809 06:32:19.255743 9150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36daf2175044481ca3ea1b9982d8d7de" candidate_uuid: "a658de280710480b91d583d4d9e854ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5356d609804e4a30ac579899c0f2986a"
I20260809 06:32:19.255785 9581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36daf2175044481ca3ea1b9982d8d7de" candidate_uuid: "a658de280710480b91d583d4d9e854ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c"
I20260809 06:32:19.255932 9150 raft_consensus.cc:3037] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:19.255972 9581 raft_consensus.cc:3037] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:19.258095 9150 raft_consensus.cc:2454] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a658de280710480b91d583d4d9e854ec in term 1.
I20260809 06:32:19.258188 9581 raft_consensus.cc:2454] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a658de280710480b91d583d4d9e854ec in term 1.
I20260809 06:32:19.258493 9276 leader_election.cc:302] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5356d609804e4a30ac579899c0f2986a, a658de280710480b91d583d4d9e854ec; no voters:
I20260809 06:32:19.258772 9708 raft_consensus.cc:2781] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:19.259176 9708 raft_consensus.cc:686] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 1 LEADER]: Becoming Leader. State: Replica: a658de280710480b91d583d4d9e854ec, State: Running, Role: LEADER
I20260809 06:32:19.259675 9708 consensus_queue.cc:237] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } }
I20260809 06:32:19.265132 7780 catalog_manager.cc:5495] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec reported cstate change: term changed from 0 to 1, leader changed from <none> to a658de280710480b91d583d4d9e854ec (127.30.78.66). New cstate: current_term: 1 leader_uuid: "a658de280710480b91d583d4d9e854ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } health_report { overall_health: UNKNOWN } } }
W20260809 06:32:19.277212 9222 tablet.cc:2369] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:32:19.301522 9692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.296238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60980 (local address 127.30.78.66:41201)
0809 06:32:19.296393 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.296398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.296413 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:32:19.296619 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.296623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.296701 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.296829 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:19.297216 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.298086 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.299482 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.299880 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.299989 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.300458 (+ 469us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:19.300953 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:19.301092 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.301192 (+ 100us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.301272 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 06:32:19.310104 9581 raft_consensus.cc:1261] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [term 1 FOLLOWER]: Refusing update from remote peer a658de280710480b91d583d4d9e854ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:19.310169 9150 raft_consensus.cc:1261] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [term 1 FOLLOWER]: Refusing update from remote peer a658de280710480b91d583d4d9e854ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:19.311066 9715 consensus_queue.cc:1035] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:19.311403 9708 consensus_queue.cc:1035] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:19.327525 9721 mvcc.cc:205] Tried to move back new op lower bound from 7316509242604830720 to 7316509242411139072. Current Snapshot: MvccSnapshot[applied={T|T < 7316509242604830720}]
I20260809 06:32:19.328173 9723 mvcc.cc:205] Tried to move back new op lower bound from 7316509242604830720 to 7316509242411139072. Current Snapshot: MvccSnapshot[applied={T|T < 7316509242604830720}]
I20260809 06:32:19.344301 7780 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:19.344534 7780 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:19.349759 7780 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab1757cc74244e28b673c196f6a467c7: Sending DeleteTablet for 3 replicas of tablet 36daf2175044481ca3ea1b9982d8d7de
I20260809 06:32:19.351511 9117 tablet_service.cc:1514] Processing DeleteTablet for tablet 36daf2175044481ca3ea1b9982d8d7de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:19 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:42896
I20260809 06:32:19.352348 9732 tablet_replica.cc:330] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: stopping tablet replica
I20260809 06:32:19.353049 9334 tablet_service.cc:1514] Processing DeleteTablet for tablet 36daf2175044481ca3ea1b9982d8d7de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:19 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:60970
I20260809 06:32:19.353049 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 36daf2175044481ca3ea1b9982d8d7de with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:19 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:36322
I20260809 06:32:19.353909 9734 tablet_replica.cc:330] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: stopping tablet replica
I20260809 06:32:19.354884 9732 raft_consensus.cc:2229] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:19.355605 9732 raft_consensus.cc:2258] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:19.357820 9732 ts_tablet_manager.cc:1905] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:19.364796 9732 ts_tablet_manager.cc:1918] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:19.364956 9732 log.cc:1196] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/36daf2175044481ca3ea1b9982d8d7de
I20260809 06:32:19.365056 9735 tablet_replica.cc:330] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: stopping tablet replica
I20260809 06:32:19.365403 9735 raft_consensus.cc:2229] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:19.365536 9732 ts_tablet_manager.cc:1939] T 36daf2175044481ca3ea1b9982d8d7de P 5356d609804e4a30ac579899c0f2986a: Deleting consensus metadata
I20260809 06:32:19.365875 9735 raft_consensus.cc:2258] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:19.367165 7753 catalog_manager.cc:4841] TS 5356d609804e4a30ac579899c0f2986a (127.30.78.65:46395): tablet 36daf2175044481ca3ea1b9982d8d7de (table test-table [id=dff55014981e477ebbb5faf9f93573b5]) successfully deleted
I20260809 06:32:19.354406 9734 raft_consensus.cc:2229] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:32:19.370330 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 7723
I20260809 06:32:19.371376 7821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:19.372164 9735 ts_tablet_manager.cc:1905] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:19.370398 9734 raft_consensus.cc:2258] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:19.380125 9734 ts_tablet_manager.cc:1905] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:19.384032 9667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.355059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33698 (local address 127.30.78.125:45903)
0809 06:32:19.355225 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.355231 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.364583 (+ 9352us) server_negotiation.cc:407] Connection header received
0809 06:32:19.366129 (+ 1546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.366134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.366216 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.366309 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:19.368733 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.371183 (+ 2450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.373101 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.373772 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.373869 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.377402 (+ 3533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:19.377408 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:19.377412 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:19.377451 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.380860 (+ 3409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.381695 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.381701 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.381705 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.381863 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.382310 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.382315 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.382318 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.382654 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.382869 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.383468 (+ 599us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.383686 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260809 06:32:19.387688 9735 ts_tablet_manager.cc:1918] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:19.387866 9735 log.cc:1196] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/36daf2175044481ca3ea1b9982d8d7de
I20260809 06:32:19.388281 9735 ts_tablet_manager.cc:1939] T 36daf2175044481ca3ea1b9982d8d7de P cb2e5c5834d44b4380ed75a4409fbe7c: Deleting consensus metadata
I20260809 06:32:19.395877 9734 ts_tablet_manager.cc:1918] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:19.396029 9734 log.cc:1196] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/36daf2175044481ca3ea1b9982d8d7de
I20260809 06:32:19.396481 9734 ts_tablet_manager.cc:1939] T 36daf2175044481ca3ea1b9982d8d7de P a658de280710480b91d583d4d9e854ec: Deleting consensus metadata
I20260809 06:32:19.401338 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.370836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40446 (local address 127.30.78.124:36445)
0809 06:32:19.371004 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.371010 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.385927 (+ 14917us) server_negotiation.cc:407] Connection header received
0809 06:32:19.386080 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.386086 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.386176 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.386273 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:19.387934 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.389031 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.391016 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.391613 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.391740 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.394788 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:19.394795 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:19.394800 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:19.394839 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.398159 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.398975 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.398980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.398983 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.399200 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.399647 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.399652 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.399655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.400014 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.400234 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.400784 (+ 550us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.401020 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:32:19.524694 7751 catalog_manager.cc:4841] TS a658de280710480b91d583d4d9e854ec (127.30.78.66:41201): tablet 36daf2175044481ca3ea1b9982d8d7de (table test-table [id=dff55014981e477ebbb5faf9f93573b5]) successfully deleted
I20260809 06:32:19.525832 7751 catalog_manager.cc:4841] TS cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787): tablet 36daf2175044481ca3ea1b9982d8d7de (table test-table [id=dff55014981e477ebbb5faf9f93573b5]) successfully deleted
I20260809 06:32:19.526569 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 7723
I20260809 06:32:19.578758 9673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.564654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40454 (local address 127.30.78.124:36445)
0809 06:32:19.564845 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.564851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.564998 (+ 147us) server_negotiation.cc:407] Connection header received
0809 06:32:19.565162 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.565167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.565246 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.565353 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:19.567310 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.568005 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.569932 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.570623 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.570756 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.573587 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:19.573592 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:19.573595 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:19.573627 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.576075 (+ 2448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.576672 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.576677 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.576681 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.576860 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.577223 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.577227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.577229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.577606 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.577848 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.578176 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.578371 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:32:19.580083 9667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:19.563140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33700 (local address 127.30.78.125:45903)
0809 06:32:19.563351 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:19.563358 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:19.564388 (+ 1030us) server_negotiation.cc:407] Connection header received
0809 06:32:19.564555 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:19.564561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:19.564632 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:19.564716 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:19.566770 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.567914 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.569277 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:19.569692 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:19.569835 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:19.573021 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:19.573027 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:19.573032 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:19.573074 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:19.576429 (+ 3355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.577054 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.577059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.577063 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.577204 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:19.577537 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:19.577542 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:19.577545 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:19.578024 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:19.578246 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:19.579163 (+ 917us) server_negotiation.cc:299] Negotiation successful
0809 06:32:19.579502 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:32:20.338070 9748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.336598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:41085)
0809 06:32:20.337365 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.337553 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":1301,"threads_started":1}
I20260809 06:32:20.338254 9747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.336358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.66:51059)
0809 06:32:20.337928 (+ 1570us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.338074 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1451,"thread_start_us":1346,"threads_started":1}
W20260809 06:32:20.338477 9219 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:32807 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
W20260809 06:32:20.338687 9433 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:32807 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
I20260809 06:32:20.340816 9749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.340081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.67:55793)
0809 06:32:20.340536 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.340648 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":232,"threads_started":1}
W20260809 06:32:20.341202 9651 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:32807 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
I20260809 06:32:20.853940 9752 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab1757cc74244e28b673c196f6a467c7)
I20260809 06:32:20.854305 9752 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } }
I20260809 06:32:20.857331 9752 leader_election.cc:288] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807), c3bfbecaa02c43969783da5c7e610984 (127.30.78.124:36445)
I20260809 06:32:20.858152 9753 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab1757cc74244e28b673c196f6a467c7)
I20260809 06:32:20.858475 9753 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } }
I20260809 06:32:20.859277 9756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.858307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52034)
0809 06:32:20.858788 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.859000 (+ 212us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":253,"threads_started":1}
W20260809 06:32:20.859566 8636 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
I20260809 06:32:20.859787 9753 leader_election.cc:288] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807), ce2097dfac0447418d867b88a7c9771e (127.30.78.125:45903)
I20260809 06:32:20.868065 9756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.867677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52050)
0809 06:32:20.867828 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.867914 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260809 06:32:20.868381 8636 leader_election.cc:334] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807): Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
I20260809 06:32:20.870227 9762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.869286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52058)
0809 06:32:20.869784 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.869943 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":234,"threads_started":1}
W20260809 06:32:20.870594 8928 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
I20260809 06:32:20.872481 9762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.872078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52066)
0809 06:32:20.872239 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.872331 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 06:32:20.872722 8928 leader_election.cc:334] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807): Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
I20260809 06:32:20.874868 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.860264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:45903 (local address 127.0.0.1:33710)
0809 06:32:20.867420 (+ 7156us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.867442 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:20.867944 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:20.868708 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:20.868714 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:20.868741 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:20.869108 (+ 367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:20.869122 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:20.870556 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:20.870562 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:20.872699 (+ 2137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:20.872719 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:20.873969 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:20.873975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:20.874192 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:20.874232 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 06:32:20.874335 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 06:32:20.874479 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7022,"mutex_wait_us":3,"thread_start_us":6880,"threads_started":1}
I20260809 06:32:20.874914 9761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.860312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33710 (local address 127.30.78.125:45903)
0809 06:32:20.868448 (+ 8136us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:20.868451 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:20.868470 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:32:20.868524 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:20.868527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:20.868576 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:20.868659 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:20.869337 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:20.870388 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:20.872864 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:20.873799 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:20.873926 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:20.874029 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:20.874365 (+ 336us) server_negotiation.cc:299] Negotiation successful
0809 06:32:20.874501 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8023,"thread_start_us":7870,"threads_started":1}
I20260809 06:32:20.875375 9754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.856383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:36445 (local address 127.0.0.1:40462)
0809 06:32:20.857352 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.857374 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:20.857643 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:20.869569 (+ 11926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:20.869574 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:20.869612 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:20.870008 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:20.870021 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:20.871772 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:20.871777 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:20.873361 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:20.873373 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:20.874662 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:20.874669 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:20.874856 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:20.874891 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 06:32:20.874954 (+ 63us) client_negotiation.cc:240] Negotiation successful
0809 06:32:20.875083 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"thread_start_us":672,"threads_started":1}
I20260809 06:32:20.875917 8679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c3bfbecaa02c43969783da5c7e610984" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ce2097dfac0447418d867b88a7c9771e" is_pre_election: true
I20260809 06:32:20.876076 9757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.858858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40462 (local address 127.30.78.124:36445)
0809 06:32:20.869273 (+ 10415us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:20.869279 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:20.869293 (+ 14us) server_negotiation.cc:407] Connection header received
0809 06:32:20.869340 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:20.869343 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:20.869391 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:20.870161 (+ 770us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:20.870380 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:20.871633 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:20.873524 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:20.874439 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:20.875619 (+ 1180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:20.875709 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:20.875753 (+ 44us) server_negotiation.cc:299] Negotiation successful
0809 06:32:20.875839 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":10306,"thread_start_us":10118,"threads_started":1}
I20260809 06:32:20.876242 8679 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3bfbecaa02c43969783da5c7e610984 in term 1.
I20260809 06:32:20.876601 8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce2097dfac0447418d867b88a7c9771e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c3bfbecaa02c43969783da5c7e610984" is_pre_election: true
I20260809 06:32:20.876780 8930 leader_election.cc:302] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3bfbecaa02c43969783da5c7e610984, ce2097dfac0447418d867b88a7c9771e; no voters: ab1757cc74244e28b673c196f6a467c7
I20260809 06:32:20.876969 8970 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce2097dfac0447418d867b88a7c9771e in term 1.
I20260809 06:32:20.877228 9753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 06:32:20.877367 9753 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab1757cc74244e28b673c196f6a467c7)
I20260809 06:32:20.877466 9753 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:32:20.877431 8637 leader_election.cc:302] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3bfbecaa02c43969783da5c7e610984, ce2097dfac0447418d867b88a7c9771e; no voters: ab1757cc74244e28b673c196f6a467c7
I20260809 06:32:20.877844 9752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260809 06:32:20.877978 9752 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab1757cc74244e28b673c196f6a467c7)
I20260809 06:32:20.878089 9752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:32:20.879727 9753 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } }
I20260809 06:32:20.880386 9753 leader_election.cc:288] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [CANDIDATE]: Term 2 election: Requested vote from peers ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807), ce2097dfac0447418d867b88a7c9771e (127.30.78.125:45903)
I20260809 06:32:20.880319 9752 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } }
I20260809 06:32:20.880820 8679 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c3bfbecaa02c43969783da5c7e610984" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ce2097dfac0447418d867b88a7c9771e"
I20260809 06:32:20.881083 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.880472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52078)
0809 06:32:20.880846 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.880944 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269}
I20260809 06:32:20.881100 8679 raft_consensus.cc:2379] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c3bfbecaa02c43969783da5c7e610984 in current term 2: Already voted for candidate ce2097dfac0447418d867b88a7c9771e in this term.
I20260809 06:32:20.881529 9752 leader_election.cc:288] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 2 election: Requested vote from peers ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807), c3bfbecaa02c43969783da5c7e610984 (127.30.78.124:36445)
I20260809 06:32:20.881583 9754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.881210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52092)
0809 06:32:20.881343 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.881439 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260809 06:32:20.882261 9760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.881878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52102)
0809 06:32:20.882018 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.882109 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260809 06:32:20.882496 8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce2097dfac0447418d867b88a7c9771e" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c3bfbecaa02c43969783da5c7e610984"
I20260809 06:32:20.882575 9754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:20.882230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52108)
0809 06:32:20.882394 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:20.882466 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260809 06:32:20.882776 8970 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate ce2097dfac0447418d867b88a7c9771e in current term 2: Already voted for candidate c3bfbecaa02c43969783da5c7e610984 in this term.
W20260809 06:32:20.882761 8636 leader_election.cc:334] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807): Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
W20260809 06:32:20.882797 8928 leader_election.cc:334] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807): Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
I20260809 06:32:20.882938 8928 leader_election.cc:302] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3bfbecaa02c43969783da5c7e610984; no voters: ab1757cc74244e28b673c196f6a467c7, ce2097dfac0447418d867b88a7c9771e
I20260809 06:32:20.883186 9753 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 06:32:20.883529 8637 leader_election.cc:302] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ce2097dfac0447418d867b88a7c9771e; no voters: ab1757cc74244e28b673c196f6a467c7, c3bfbecaa02c43969783da5c7e610984
I20260809 06:32:20.883760 9752 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260809 06:32:21.340070 9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:21.339131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:54683)
0809 06:32:21.339671 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:21.339759 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":327,"threads_started":1}
I20260809 06:32:21.343034 9769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:21.341843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.67:59601)
0809 06:32:21.342784 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:21.342858 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":853,"thread_start_us":753,"threads_started":1}
I20260809 06:32:21.343288 9767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:21.339633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.66:43313)
0809 06:32:21.343021 (+ 3388us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:21.343099 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3290,"thread_start_us":3209,"threads_started":1}
I20260809 06:32:22.342298 9772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.341211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:32771)
0809 06:32:22.341943 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.342072 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":240,"threads_started":1}
I20260809 06:32:22.344807 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.344071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.66:58553)
0809 06:32:22.344507 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.344614 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":207,"threads_started":1}
I20260809 06:32:22.344895 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.343856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.67:52869)
0809 06:32:22.344668 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.344745 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":620,"threads_started":1}
I20260809 06:32:22.504030 9778 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:22.504240 9778 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } }
I20260809 06:32:22.504853 9778 leader_election.cc:288] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807), c3bfbecaa02c43969783da5c7e610984 (127.30.78.124:36445)
I20260809 06:32:22.505463 8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce2097dfac0447418d867b88a7c9771e" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c3bfbecaa02c43969783da5c7e610984" is_pre_election: true
I20260809 06:32:22.505692 8970 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ce2097dfac0447418d867b88a7c9771e in term 2.
I20260809 06:32:22.505857 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.505071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52336)
0809 06:32:22.505519 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.505618 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":211,"threads_started":1}
I20260809 06:32:22.506208 8637 leader_election.cc:302] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3bfbecaa02c43969783da5c7e610984, ce2097dfac0447418d867b88a7c9771e; no voters:
I20260809 06:32:22.506528 9778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260809 06:32:22.506669 9778 raft_consensus.cc:482] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:22.506775 9778 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 2 FOLLOWER]: Advancing to term 3
I20260809 06:32:22.507261 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.506930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52340)
0809 06:32:22.507060 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.507135 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260809 06:32:22.507422 8636 leader_election.cc:334] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807): Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
I20260809 06:32:22.509217 9778 raft_consensus.cc:504] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } }
I20260809 06:32:22.509838 9778 leader_election.cc:288] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 3 election: Requested vote from peers ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807), c3bfbecaa02c43969783da5c7e610984 (127.30.78.124:36445)
I20260809 06:32:22.510294 8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ce2097dfac0447418d867b88a7c9771e" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c3bfbecaa02c43969783da5c7e610984"
I20260809 06:32:22.510358 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.509911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52356)
0809 06:32:22.510127 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.510217 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260809 06:32:22.510598 8970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 2 FOLLOWER]: Advancing to term 3
I20260809 06:32:22.511252 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.510961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52366)
0809 06:32:22.511094 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.511157 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 06:32:22.511425 8636 leader_election.cc:334] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807): Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
I20260809 06:32:22.512826 8970 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ce2097dfac0447418d867b88a7c9771e in term 3.
I20260809 06:32:22.513176 8637 leader_election.cc:302] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c3bfbecaa02c43969783da5c7e610984, ce2097dfac0447418d867b88a7c9771e; no voters: ab1757cc74244e28b673c196f6a467c7
I20260809 06:32:22.513434 9778 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 3 FOLLOWER]: Leader election won for term 3
I20260809 06:32:22.513823 9778 raft_consensus.cc:686] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [term 3 LEADER]: Becoming Leader. State: Replica: ce2097dfac0447418d867b88a7c9771e, State: Running, Role: LEADER
I20260809 06:32:22.514178 9778 consensus_queue.cc:237] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } }
I20260809 06:32:22.516026 9784 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce2097dfac0447418d867b88a7c9771e. Latest consensus state: current_term: 3 leader_uuid: "ce2097dfac0447418d867b88a7c9771e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:22.516350 9784 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:22.516968 9786 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:22.520407 9786 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:22.521157 9786 catalog_manager.cc:1259] Loaded cluster ID: c0ac497b1af24904ad9fc2d593958200
I20260809 06:32:22.521234 9786 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:22.522338 9786 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:22.523109 9786 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Loaded TSK: 0
I20260809 06:32:22.523864 9786 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:32:22.595711 8661 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33700:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:32:22.602768 8661 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:32:22.606665 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.606232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52376)
0809 06:32:22.606442 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.606524 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 06:32:22.606742 8970 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [term 3 FOLLOWER]: Refusing update from remote peer ce2097dfac0447418d867b88a7c9771e: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260809 06:32:22.607404 9784 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260809 06:32:22.607611 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.607267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:52386)
0809 06:32:22.607426 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.607491 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 06:32:22.607766 8636 consensus_peers.cc:487] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e -> Peer ab1757cc74244e28b673c196f6a467c7 (127.30.78.126:32807): Couldn't send request to peer ab1757cc74244e28b673c196f6a467c7. Status: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260809 06:32:22.610090 9791 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ce2097dfac0447418d867b88a7c9771e. Latest consensus state: current_term: 3 leader_uuid: "ce2097dfac0447418d867b88a7c9771e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:22.610388 9791 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:32:22.611372 9778 sys_catalog.cc:455] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "ce2097dfac0447418d867b88a7c9771e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:22.611683 9778 sys_catalog.cc:458] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:22.615671 9792 mvcc.cc:205] Tried to move back new op lower bound from 7316509256110858240 to 7316509255741276160. Current Snapshot: MvccSnapshot[applied={T|T < 7316509256110858240}]
I20260809 06:32:22.621251 9791 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "ce2097dfac0447418d867b88a7c9771e" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "ab1757cc74244e28b673c196f6a467c7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32807 } } peers { permanent_uuid: "ce2097dfac0447418d867b88a7c9771e" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 45903 } attrs { promote: false } } peers { permanent_uuid: "c3bfbecaa02c43969783da5c7e610984" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 36445 } attrs { promote: false } } }
I20260809 06:32:22.621513 9791 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3bfbecaa02c43969783da5c7e610984 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:32:22.633637 9779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.625224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41201 (local address 127.0.0.1:60984)
0809 06:32:22.625360 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.625392 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:22.625505 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:22.626156 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:22.626161 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:22.626186 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:22.626581 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.626597 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.628855 (+ 2258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.628862 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.631087 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.631104 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.632857 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.632863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.633057 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.633092 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 06:32:22.633184 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 06:32:22.633309 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260809 06:32:22.633751 9803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.625364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60984 (local address 127.30.78.66:41201)
0809 06:32:22.625835 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:22.625840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:22.625856 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:32:22.625916 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:22.625919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:22.625987 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:22.627316 (+ 1329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:22.627542 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.628688 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.631323 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.632623 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.632803 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.632909 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:22.633214 (+ 305us) server_negotiation.cc:299] Negotiation successful
0809 06:32:22.633360 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":256,"threads_started":1}
I20260809 06:32:22.634737 9334 tablet_service.cc:1467] Processing CreateTablet for tablet 0075de125194468ba04e7595419a88f1 (DEFAULT_TABLE table=test-table [id=10bba0e31ca24c5db79c2e529d252e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:22.635149 9334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0075de125194468ba04e7595419a88f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:22.639050 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.626495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:46395 (local address 127.0.0.1:42906)
0809 06:32:22.632587 (+ 6092us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.632601 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:22.632720 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:22.633286 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:22.633290 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:22.633314 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:22.634018 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.634036 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.635523 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.635527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.636737 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.636748 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.638278 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.638284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.638469 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.638505 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:32:22.638599 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 06:32:22.638721 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5975,"thread_start_us":5857,"threads_started":1}
I20260809 06:32:22.639089 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.626925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42906 (local address 127.30.78.65:46395)
0809 06:32:22.627436 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:22.627443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:22.632688 (+ 5245us) server_negotiation.cc:407] Connection header received
0809 06:32:22.632886 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:22.632891 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:22.632985 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:22.633059 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:22.634513 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.635375 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.636889 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.638102 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.638233 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.638335 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:22.638631 (+ 296us) server_negotiation.cc:299] Negotiation successful
0809 06:32:22.638764 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":241,"threads_started":1}
I20260809 06:32:22.640195 9117 tablet_service.cc:1467] Processing CreateTablet for tablet 0075de125194468ba04e7595419a88f1 (DEFAULT_TABLE table=test-table [id=10bba0e31ca24c5db79c2e529d252e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:22.640661 9117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0075de125194468ba04e7595419a88f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:22.641229 9812 tablet_bootstrap.cc:492] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: Bootstrap starting.
I20260809 06:32:22.642977 9812 tablet_bootstrap.cc:654] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:22.643999 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.626025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:42787 (local address 127.0.0.1:36332)
0809 06:32:22.626796 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.626813 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:22.626928 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:22.637816 (+ 10888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:22.637821 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:22.637844 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:22.638144 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.638153 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.639662 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.639667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.641582 (+ 1915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.641597 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.643236 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.643243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.643408 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.643438 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:32:22.643539 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 06:32:22.643676 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":591,"threads_started":1}
I20260809 06:32:22.644035 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.626233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36332 (local address 127.30.78.67:42787)
0809 06:32:22.637555 (+ 11322us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:22.637559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:22.637574 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:32:22.637630 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:22.637633 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:22.637687 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:22.637806 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:22.638346 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.639511 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.641824 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.642987 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.643168 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.643273 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:22.643587 (+ 314us) server_negotiation.cc:299] Negotiation successful
0809 06:32:22.643721 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11221,"thread_start_us":11120,"threads_started":1}
I20260809 06:32:22.645133 9548 tablet_service.cc:1467] Processing CreateTablet for tablet 0075de125194468ba04e7595419a88f1 (DEFAULT_TABLE table=test-table [id=10bba0e31ca24c5db79c2e529d252e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:22.645406 9812 tablet_bootstrap.cc:492] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: No bootstrap required, opened a new log
I20260809 06:32:22.645538 9812 ts_tablet_manager.cc:1397] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 06:32:22.645546 9548 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0075de125194468ba04e7595419a88f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:22.646236 9812 raft_consensus.cc:348] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } }
I20260809 06:32:22.646515 9812 raft_consensus.cc:374] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:22.646627 9814 tablet_bootstrap.cc:492] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: Bootstrap starting.
I20260809 06:32:22.646826 9812 raft_consensus.cc:729] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a658de280710480b91d583d4d9e854ec, State: Initialized, Role: FOLLOWER
I20260809 06:32:22.647532 9812 consensus_queue.cc:260] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } }
I20260809 06:32:22.648612 9812 ts_tablet_manager.cc:1428] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 06:32:22.648893 9814 tablet_bootstrap.cc:654] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:22.649214 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.648797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.66:39955)
0809 06:32:22.649021 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.649100 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260809 06:32:22.650682 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.650213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.66:39143)
0809 06:32:22.650447 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.650538 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
I20260809 06:32:22.652122 9434 heartbeater.cc:503] Master 127.30.78.125:45903 was elected leader, sending a full tablet report...
I20260809 06:32:22.652247 9814 tablet_bootstrap.cc:492] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: No bootstrap required, opened a new log
I20260809 06:32:22.652392 9814 ts_tablet_manager.cc:1397] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260809 06:32:22.653386 9814 raft_consensus.cc:348] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } }
I20260809 06:32:22.653640 9814 raft_consensus.cc:374] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:22.653784 9814 raft_consensus.cc:729] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5356d609804e4a30ac579899c0f2986a, State: Initialized, Role: FOLLOWER
I20260809 06:32:22.654034 9814 consensus_queue.cc:260] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } }
I20260809 06:32:22.654829 9814 ts_tablet_manager.cc:1428] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:22.655869 9824 tablet_bootstrap.cc:492] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: Bootstrap starting.
I20260809 06:32:22.656095 9772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.655493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:53267)
0809 06:32:22.655855 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.655951 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253}
I20260809 06:32:22.656730 9221 heartbeater.cc:503] Master 127.30.78.125:45903 was elected leader, sending a full tablet report...
I20260809 06:32:22.658097 9824 tablet_bootstrap.cc:654] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:22.660036 9824 tablet_bootstrap.cc:492] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: No bootstrap required, opened a new log
I20260809 06:32:22.660146 9824 ts_tablet_manager.cc:1397] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 06:32:22.660732 9824 raft_consensus.cc:348] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } }
I20260809 06:32:22.660926 9824 raft_consensus.cc:374] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:22.660993 9824 raft_consensus.cc:729] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb2e5c5834d44b4380ed75a4409fbe7c, State: Initialized, Role: FOLLOWER
I20260809 06:32:22.661175 9824 consensus_queue.cc:260] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } }
I20260809 06:32:22.661851 9824 ts_tablet_manager.cc:1428] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:22.662427 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.662102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.67:44757)
0809 06:32:22.662240 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.662315 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 06:32:22.663400 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.662972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.67:42491)
0809 06:32:22.663140 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.663231 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 06:32:22.663877 9652 heartbeater.cc:503] Master 127.30.78.125:45903 was elected leader, sending a full tablet report...
I20260809 06:32:22.717393 9822 raft_consensus.cc:482] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:22.717643 9822 raft_consensus.cc:504] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } }
I20260809 06:32:22.719290 9822 leader_election.cc:288] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a658de280710480b91d583d4d9e854ec (127.30.78.66:41201), cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787)
I20260809 06:32:22.724690 9803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.719594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:52975 (local address 127.30.78.66:41201)
0809 06:32:22.719768 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:22.719774 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:22.719796 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:32:22.719939 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:22.719945 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:22.720021 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:22.720117 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:22.720637 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.721312 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.723056 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.723826 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.723974 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.724050 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:22.724315 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 06:32:22.724448 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:32:22.724722 9772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.719491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41201 (local address 127.30.78.65:52975)
0809 06:32:22.719645 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.719664 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:22.719784 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:22.720169 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:22.720175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:22.720202 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:22.720483 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.720493 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.721461 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.721465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.722893 (+ 1428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.722906 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.724016 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.724022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.724163 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.724187 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:32:22.724266 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 06:32:22.724402 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260809 06:32:22.725248 9828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.719839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:42787 (local address 127.30.78.65:49173)
0809 06:32:22.720385 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.720401 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:22.720522 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:22.720794 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:22.720798 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:22.720821 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:22.721124 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.721133 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.722112 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.722117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.723429 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:22.723442 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.724560 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.724567 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:22.724707 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.724734 (+ 27us) client_negotiation.cc:769] Sending connection context
0809 06:32:22.724818 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 06:32:22.724946 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":340,"threads_started":1}
I20260809 06:32:22.725467 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.719957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:49173 (local address 127.30.78.67:42787)
0809 06:32:22.720165 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:22.720171 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:22.720488 (+ 317us) server_negotiation.cc:407] Connection header received
0809 06:32:22.720636 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:22.720641 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:22.720699 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:22.720770 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:22.721267 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.721990 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.723575 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.724339 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.724490 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.724561 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:22.725108 (+ 547us) server_negotiation.cc:299] Negotiation successful
0809 06:32:22.725229 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:32:22.725497 9364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0075de125194468ba04e7595419a88f1" candidate_uuid: "5356d609804e4a30ac579899c0f2986a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a658de280710480b91d583d4d9e854ec" is_pre_election: true
I20260809 06:32:22.725934 9364 raft_consensus.cc:2454] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5356d609804e4a30ac579899c0f2986a in term 0.
I20260809 06:32:22.726188 9581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0075de125194468ba04e7595419a88f1" candidate_uuid: "5356d609804e4a30ac579899c0f2986a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" is_pre_election: true
I20260809 06:32:22.726434 9581 raft_consensus.cc:2454] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5356d609804e4a30ac579899c0f2986a in term 0.
I20260809 06:32:22.726465 9056 leader_election.cc:302] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5356d609804e4a30ac579899c0f2986a, a658de280710480b91d583d4d9e854ec; no voters:
I20260809 06:32:22.726840 9822 raft_consensus.cc:2781] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:32:22.726967 9822 raft_consensus.cc:482] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:22.727059 9822 raft_consensus.cc:3037] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:22.729099 9822 raft_consensus.cc:504] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } }
I20260809 06:32:22.729593 9822 leader_election.cc:288] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [CANDIDATE]: Term 1 election: Requested vote from peers a658de280710480b91d583d4d9e854ec (127.30.78.66:41201), cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787)
I20260809 06:32:22.729982 9364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0075de125194468ba04e7595419a88f1" candidate_uuid: "5356d609804e4a30ac579899c0f2986a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a658de280710480b91d583d4d9e854ec"
I20260809 06:32:22.730063 9581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0075de125194468ba04e7595419a88f1" candidate_uuid: "5356d609804e4a30ac579899c0f2986a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c"
I20260809 06:32:22.730144 9364 raft_consensus.cc:3037] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:22.730247 9581 raft_consensus.cc:3037] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:22.732131 9364 raft_consensus.cc:2454] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5356d609804e4a30ac579899c0f2986a in term 1.
I20260809 06:32:22.732213 9581 raft_consensus.cc:2454] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5356d609804e4a30ac579899c0f2986a in term 1.
I20260809 06:32:22.732478 9056 leader_election.cc:302] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5356d609804e4a30ac579899c0f2986a, a658de280710480b91d583d4d9e854ec; no voters:
I20260809 06:32:22.732719 9822 raft_consensus.cc:2781] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:22.733122 9822 raft_consensus.cc:686] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 1 LEADER]: Becoming Leader. State: Replica: 5356d609804e4a30ac579899c0f2986a, State: Running, Role: LEADER
I20260809 06:32:22.733496 9822 consensus_queue.cc:237] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } }
I20260809 06:32:22.734021 9828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.733594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:36663)
0809 06:32:22.733820 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.733914 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260809 06:32:22.736938 8658 catalog_manager.cc:5495] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5356d609804e4a30ac579899c0f2986a (127.30.78.65). New cstate: current_term: 1 leader_uuid: "5356d609804e4a30ac579899c0f2986a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5356d609804e4a30ac579899c0f2986a" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46395 } health_report { overall_health: HEALTHY } } }
I20260809 06:32:22.780539 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.774762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56816 (local address 127.30.78.65:46395)
0809 06:32:22.774964 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:22.774970 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:22.774989 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:32:22.775198 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:22.775202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:22.775281 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:22.775417 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:22.775775 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.776478 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.778090 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.778812 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.778937 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.779270 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:22.779958 (+ 688us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:22.780108 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:22.780158 (+ 50us) server_negotiation.cc:299] Negotiation successful
0809 06:32:22.780240 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:32:22.784946 9581 raft_consensus.cc:1261] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [term 1 FOLLOWER]: Refusing update from remote peer 5356d609804e4a30ac579899c0f2986a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:22.785245 9364 raft_consensus.cc:1261] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [term 1 FOLLOWER]: Refusing update from remote peer 5356d609804e4a30ac579899c0f2986a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:22.785660 9829 consensus_queue.cc:1035] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb2e5c5834d44b4380ed75a4409fbe7c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:22.786096 9822 consensus_queue.cc:1035] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a658de280710480b91d583d4d9e854ec" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:22.788365 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.787695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.67:54511)
0809 06:32:22.788097 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.788195 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283}
I20260809 06:32:22.788710 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.788211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.66:57999)
0809 06:32:22.788457 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.788550 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117}
I20260809 06:32:22.793529 9833 mvcc.cc:205] Tried to move back new op lower bound from 7316509256839462912 to 7316509256640057344. Current Snapshot: MvccSnapshot[applied={T|T < 7316509256839462912}]
I20260809 06:32:22.794054 9828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.793549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:33379)
0809 06:32:22.793776 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.793874 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260809 06:32:22.795183 9828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.794773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:50083)
0809 06:32:22.794963 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.795037 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260809 06:32:22.798538 9776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.798077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.67:51819)
0809 06:32:22.798276 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.798365 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 06:32:22.801491 9777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.801003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.66:46529)
0809 06:32:22.801204 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.801296 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260809 06:32:22.802366 9828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.801941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.30.78.65:60675)
0809 06:32:22.802112 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:22.802192 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 06:32:22.806820 8658 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:22.807097 8658 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33700:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:22.812268 8658 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ce2097dfac0447418d867b88a7c9771e: Sending DeleteTablet for 3 replicas of tablet 0075de125194468ba04e7595419a88f1
I20260809 06:32:22.813047 9334 tablet_service.cc:1514] Processing DeleteTablet for tablet 0075de125194468ba04e7595419a88f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:22 UTC) from {username='oryx', principal='oryx/127.30.78.125@KRBTEST.COM'} at 127.0.0.1:60984
I20260809 06:32:22.813467 9548 tablet_service.cc:1514] Processing DeleteTablet for tablet 0075de125194468ba04e7595419a88f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:22 UTC) from {username='oryx', principal='oryx/127.30.78.125@KRBTEST.COM'} at 127.0.0.1:36332
I20260809 06:32:22.813692 9847 tablet_replica.cc:330] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: stopping tablet replica
I20260809 06:32:22.813822 9117 tablet_service.cc:1514] Processing DeleteTablet for tablet 0075de125194468ba04e7595419a88f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:22 UTC) from {username='oryx', principal='oryx/127.30.78.125@KRBTEST.COM'} at 127.0.0.1:42906
I20260809 06:32:22.813910 9847 raft_consensus.cc:2229] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:22.814203 9847 raft_consensus.cc:2258] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:22.815230 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 8910
I20260809 06:32:22.824118 9847 ts_tablet_manager.cc:1905] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:22.824469 9849 tablet_replica.cc:330] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: stopping tablet replica
I20260809 06:32:22.824658 9849 raft_consensus.cc:2229] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:32:22.825273 9849 raft_consensus.cc:2258] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:22.825846 9848 tablet_replica.cc:330] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: stopping tablet replica
I20260809 06:32:22.826165 9848 raft_consensus.cc:2229] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:22.826498 9848 raft_consensus.cc:2258] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:22.827625 9848 ts_tablet_manager.cc:1905] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:22.831487 9847 ts_tablet_manager.cc:1918] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:22.831629 9847 log.cc:1196] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/0075de125194468ba04e7595419a88f1
I20260809 06:32:22.832077 9847 ts_tablet_manager.cc:1939] T 0075de125194468ba04e7595419a88f1 P a658de280710480b91d583d4d9e854ec: Deleting consensus metadata
I20260809 06:32:22.833280 8637 catalog_manager.cc:4841] TS a658de280710480b91d583d4d9e854ec (127.30.78.66:41201): tablet 0075de125194468ba04e7595419a88f1 (table test-table [id=10bba0e31ca24c5db79c2e529d252e82]) successfully deleted
I20260809 06:32:22.834919 9848 ts_tablet_manager.cc:1918] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:22.835088 9848 log.cc:1196] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/0075de125194468ba04e7595419a88f1
I20260809 06:32:22.835532 9848 ts_tablet_manager.cc:1939] T 0075de125194468ba04e7595419a88f1 P cb2e5c5834d44b4380ed75a4409fbe7c: Deleting consensus metadata
I20260809 06:32:22.836607 8637 catalog_manager.cc:4841] TS cb2e5c5834d44b4380ed75a4409fbe7c (127.30.78.67:42787): tablet 0075de125194468ba04e7595419a88f1 (table test-table [id=10bba0e31ca24c5db79c2e529d252e82]) successfully deleted
I20260809 06:32:22.838454 9849 ts_tablet_manager.cc:1905] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:22.845534 9849 ts_tablet_manager.cc:1918] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:22.845758 9849 log.cc:1196] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/0075de125194468ba04e7595419a88f1
I20260809 06:32:22.846261 9849 ts_tablet_manager.cc:1939] T 0075de125194468ba04e7595419a88f1 P 5356d609804e4a30ac579899c0f2986a: Deleting consensus metadata
I20260809 06:32:22.847347 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.817093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56818 (local address 127.30.78.65:46395)
0809 06:32:22.817274 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:22.817280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:22.833452 (+ 16172us) server_negotiation.cc:407] Connection header received
0809 06:32:22.833614 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:22.833618 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:22.833698 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:22.833814 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:22.835133 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.836035 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.837417 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.837950 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.838097 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.840720 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:22.840735 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:22.840750 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:22.840780 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:22.844047 (+ 3267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:22.844649 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:22.844658 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:22.844660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:22.844808 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:22.845231 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:22.845236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:22.845239 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:22.845754 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:22.846064 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:22.846688 (+ 624us) server_negotiation.cc:299] Negotiation successful
0809 06:32:22.846952 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:32:22.848795 9206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:22.849640 8640 catalog_manager.cc:4841] TS 5356d609804e4a30ac579899c0f2986a (127.30.78.65:46395): tablet 0075de125194468ba04e7595419a88f1 (table test-table [id=10bba0e31ca24c5db79c2e529d252e82]) successfully deleted
I20260809 06:32:22.952395 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 8910
I20260809 06:32:22.976172 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 9238
I20260809 06:32:22.990809 9803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:22.976851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38450 (local address 127.30.78.66:41201)
0809 06:32:22.977056 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:22.977060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:22.977106 (+ 46us) server_negotiation.cc:407] Connection header received
0809 06:32:22.977253 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:22.977256 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:22.977319 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:22.977409 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:22.978713 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.979415 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.981134 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:22.981800 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:22.981925 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:22.985260 (+ 3335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:22.985277 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:22.985293 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:22.985327 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:22.988195 (+ 2868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:22.988957 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:22.988964 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:22.988967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:22.989084 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:22.989469 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:22.989472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:22.989474 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:22.989870 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:22.990142 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:22.990373 (+ 231us) server_negotiation.cc:299] Negotiation successful
0809 06:32:22.990532 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 06:32:22.991494 9424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:23.109333 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 9238
I20260809 06:32:23.136775 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 9451
I20260809 06:32:23.141959 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:23.141410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:43592)
0809 06:32:23.141564 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:23.141644 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260809 06:32:23.143149 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:23.142800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:32807 (local address 127.0.0.1:43596)
0809 06:32:23.142950 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:23.143043 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:32807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 06:32:23.149938 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:23.137483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47246 (local address 127.30.78.67:42787)
0809 06:32:23.137671 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:23.137676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:23.137695 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:32:23.137830 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:23.137833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:23.137902 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:23.137982 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:23.139270 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:23.140063 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:23.141462 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:23.141963 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:23.142081 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:23.144656 (+ 2575us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:23.144670 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:23.144687 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:23.144730 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:23.147301 (+ 2571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:23.147935 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:23.147943 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:23.147945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:23.148085 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:23.148426 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:23.148429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:23.148431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:23.148774 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:23.149053 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:23.149356 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 06:32:23.149582 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:32:23.150550 9641 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:23.242743 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 9451
I20260809 06:32:23.268031 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 8456
I20260809 06:32:23.269052 8705 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:23.392095 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 8456
W20260809 06:32:23.416666 8928 connection.cc:535] server connection from 127.0.0.1:40462 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 06:32:23.417071 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 8600
I20260809 06:32:23.418071 9000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:23.531620 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 8600
2026-08-09T06:32:23Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11041 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:32:23 dist-test-slave-cvwc krb5kdc[9863](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:32:23 dist-test-slave-cvwc krb5kdc[9863](info): set up 2 sockets
Aug 09 06:32:23 dist-test-slave-cvwc krb5kdc[9863](info): commencing operation
krb5kdc: starting...
W20260809 06:32:24.727792 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:32:24 dist-test-slave-cvwc krb5kdc[9863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:32:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:24Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.126.keytab.
Entry for principal oryx/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.126.keytab.
I20260809 06:32:24.938802 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33933
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.126.keytab
--principal=oryx/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:33933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:25.256281 9881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:25.256582 9881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:25.256726 9881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:25.263751 9881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:25.263863 9881 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260809 06:32:25.263931 9881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:25.264014 9881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:25.264081 9881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:25.264163 9881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:25.273674 9881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:33933
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.126.keytab
--principal=oryx/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:25.274966 9881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:25.276253 9881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:25.287350 9886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:25.287437 9890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:25.287458 9887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:25.288353 9881 server_base.cc:1034] running on GCE node
I20260809 06:32:25.289070 9881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:25.290350 9881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:25.291566 9881 hybrid_clock.cc:648] HybridClock initialized: now 1786257145291505 us; error 30 us; skew 500 ppm
I20260809 06:32:25.291860 9881 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:25 dist-test-slave-cvwc krb5kdc[9863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257145, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:25.294782 9881 init.cc:377] Logged in from keytab as oryx/127.30.78.126@KRBTEST.COM (short username oryx)
I20260809 06:32:25.296092 9881 webserver.cc:460] Webserver started at http://127.30.78.126:41871/ using document root <none> and password file <none>
I20260809 06:32:25.296725 9881 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:25.296823 9881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:25.297128 9881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:25.299979 9881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "ff927487201644ec92f92316a16d628c"
format_stamp: "Formatted at 2026-08-09 06:32:25 on dist-test-slave-cvwc"
server_key: "57d5f6bb8a04dbbaef91320c2574beec"
server_key_iv: "76118204055f635e9b4f6cbbe4b61d69"
server_key_version: "encryptionkey@0"
I20260809 06:32:25.300732 9881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "ff927487201644ec92f92316a16d628c"
format_stamp: "Formatted at 2026-08-09 06:32:25 on dist-test-slave-cvwc"
server_key: "57d5f6bb8a04dbbaef91320c2574beec"
server_key_iv: "76118204055f635e9b4f6cbbe4b61d69"
server_key_version: "encryptionkey@0"
I20260809 06:32:25.305462 9881 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:32:25.308653 9898 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:25.309872 9881 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:32:25.310034 9881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "ff927487201644ec92f92316a16d628c"
format_stamp: "Formatted at 2026-08-09 06:32:25 on dist-test-slave-cvwc"
server_key: "57d5f6bb8a04dbbaef91320c2574beec"
server_key_iv: "76118204055f635e9b4f6cbbe4b61d69"
server_key_version: "encryptionkey@0"
I20260809 06:32:25.310221 9881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:25.346385 9881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:25.350059 9881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:25.350292 9881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:25.369479 9881 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:33933
I20260809 06:32:25.369500 9987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:33933 every 8 connection(s)
I20260809 06:32:25.370770 9881 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:25.374328 9989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:25.376117 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 9881
I20260809 06:32:25.376331 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:25.377151 31033 external_mini_cluster.cc:1428] Setting key 7dffdc91a02ef190c5bb18260f5e94c6
I20260809 06:32:25.386439 9989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c: Bootstrap starting.
I20260809 06:32:25.390045 9989 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:25.391196 9989 log.cc:824] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:32:25 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:25.394300 9989 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c: No bootstrap required, opened a new log
I20260809 06:32:25.400408 9994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:25.379172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58630 (local address 127.30.78.126:33933)
0809 06:32:25.379928 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:25.379940 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:25.379980 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:32:25.381657 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:25.381679 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:25.382067 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:25.382358 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:25.384099 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.385416 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.387089 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.387750 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.387884 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:25.392525 (+ 4641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:25.392535 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:25.392552 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:25.392591 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:25.396288 (+ 3697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:25.396904 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:25.396916 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:25.396928 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:25.397125 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:25.397440 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:25.397445 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:25.397448 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:25.398145 (+ 697us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:25.398448 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:25.398734 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 06:32:25.399122 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":355,"threads_started":1}
I20260809 06:32:25.403906 9989 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff927487201644ec92f92316a16d628c" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33933 } }
I20260809 06:32:25.404206 9989 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:25.404274 9989 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff927487201644ec92f92316a16d628c, State: Initialized, Role: FOLLOWER
I20260809 06:32:25.404750 9989 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff927487201644ec92f92316a16d628c" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33933 } }
I20260809 06:32:25.404963 9989 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:25.405057 9989 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:25.405172 9989 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:25.407155 9989 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff927487201644ec92f92316a16d628c" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33933 } }
I20260809 06:32:25.407564 9989 leader_election.cc:302] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff927487201644ec92f92316a16d628c; no voters:
I20260809 06:32:25.408134 9989 leader_election.cc:288] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:25.408264 9996 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:25.408919 9996 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [term 1 LEADER]: Becoming Leader. State: Replica: ff927487201644ec92f92316a16d628c, State: Running, Role: LEADER
I20260809 06:32:25.409384 9996 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff927487201644ec92f92316a16d628c" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33933 } }
I20260809 06:32:25.410023 9989 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:25.412194 9998 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff927487201644ec92f92316a16d628c. Latest consensus state: current_term: 1 leader_uuid: "ff927487201644ec92f92316a16d628c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff927487201644ec92f92316a16d628c" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33933 } } }
I20260809 06:32:25.412145 9997 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff927487201644ec92f92316a16d628c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff927487201644ec92f92316a16d628c" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33933 } } }
I20260809 06:32:25.412626 9998 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:25.412650 9997 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:25.413638 10008 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:25.419243 10008 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:25.427397 10008 catalog_manager.cc:1347] Generated new cluster ID: 0ad6a1651a6a4fb4b482f5ad08441cdc
I20260809 06:32:25.427486 10008 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:25.448645 10008 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:25.449940 10008 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:25.457558 10008 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c: Generated new TSK 0
I20260809 06:32:25.458554 10008 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab.
Entry for principal oryx/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab.
I20260809 06:32:25.517781 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33933
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab
--principal=oryx/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:25.832664 10032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:25.832909 10032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:25.833045 10032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:25.839972 10032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:25.840073 10032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:25.840197 10032 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:32:25.840299 10032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:25.849504 10032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab
--principal=oryx/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.78.126:33933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:25.850651 10032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:25.851912 10032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:25.863864 10039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:25.863889 10043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:25.863981 10040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:25.865015 10032 server_base.cc:1034] running on GCE node
I20260809 06:32:25.865569 10032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:25.866442 10032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:25.867643 10032 hybrid_clock.cc:648] HybridClock initialized: now 1786257145867586 us; error 30 us; skew 500 ppm
I20260809 06:32:25.867910 10032 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:25 dist-test-slave-cvwc krb5kdc[9863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257145, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:25.870818 10032 init.cc:377] Logged in from keytab as oryx/127.30.78.65@KRBTEST.COM (short username oryx)
I20260809 06:32:25.872113 10032 webserver.cc:460] Webserver started at http://127.30.78.65:41403/ using document root <none> and password file <none>
I20260809 06:32:25.872731 10032 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:25.872828 10032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:25.873131 10032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:25.875953 10032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "bb3ce8feb4564684963b7ad1a0d024e8"
format_stamp: "Formatted at 2026-08-09 06:32:25 on dist-test-slave-cvwc"
server_key: "e593f5e7fdb82659fa5b7c0d615e04b6"
server_key_iv: "e221be58f1c65251c988022a17494e89"
server_key_version: "encryptionkey@0"
I20260809 06:32:25.876725 10032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "bb3ce8feb4564684963b7ad1a0d024e8"
format_stamp: "Formatted at 2026-08-09 06:32:25 on dist-test-slave-cvwc"
server_key: "e593f5e7fdb82659fa5b7c0d615e04b6"
server_key_iv: "e221be58f1c65251c988022a17494e89"
server_key_version: "encryptionkey@0"
I20260809 06:32:25.882059 10032 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260809 06:32:25.885208 10057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:25.886430 10032 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:32:25.886569 10032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "bb3ce8feb4564684963b7ad1a0d024e8"
format_stamp: "Formatted at 2026-08-09 06:32:25 on dist-test-slave-cvwc"
server_key: "e593f5e7fdb82659fa5b7c0d615e04b6"
server_key_iv: "e221be58f1c65251c988022a17494e89"
server_key_version: "encryptionkey@0"
I20260809 06:32:25.886755 10032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:25.920501 10032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:25.924074 10032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:25.924309 10032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:25.926817 10032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:25.926913 10032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:25.927069 10032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:25.927146 10032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:32:25 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257145, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:25.947072 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:25.927207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:51135 (local address 127.30.78.126:33933)
0809 06:32:25.927652 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:25.927658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:25.928765 (+ 1107us) server_negotiation.cc:407] Connection header received
0809 06:32:25.930800 (+ 2035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:25.930806 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:25.930891 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:25.931015 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:25.932982 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.934117 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.936428 (+ 2311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.936865 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.936985 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:25.941244 (+ 4259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:25.941249 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:25.941252 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:25.941285 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:25.943902 (+ 2617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:25.944765 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:25.944771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:25.944774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:25.944930 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:25.945309 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:25.945314 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:25.945318 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:25.945679 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:25.945858 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:25.946419 (+ 561us) server_negotiation.cc:299] Negotiation successful
0809 06:32:25.946653 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":224,"threads_started":1}
I20260809 06:32:25.947937 10071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:25.927786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33933 (local address 127.30.78.65:51135)
0809 06:32:25.928590 (+ 804us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:25.928644 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:25.930512 (+ 1868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:25.931257 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:25.931272 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:25.931993 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:25.932774 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:25.932808 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.934270 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.934275 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:25.936287 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:25.936304 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.937099 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.937108 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:25.937378 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:25.938100 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:25.938139 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:25.941045 (+ 2906us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:25.944065 (+ 3020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:25.944073 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:25.944088 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:25.944640 (+ 552us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:25.945041 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:25.945045 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:25.945047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:25.945220 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:25.945803 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:25.945808 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:25.946100 (+ 292us) client_negotiation.cc:769] Sending connection context
0809 06:32:25.946308 (+ 208us) client_negotiation.cc:240] Negotiation successful
0809 06:32:25.946639 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":329,"threads_started":1}
I20260809 06:32:25.968700 10180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:25.954784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33933 (local address 127.30.78.65:33115)
0809 06:32:25.955506 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:25.955533 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:25.955731 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:25.956048 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:25.956054 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:25.956613 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:25.956994 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:25.957007 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.958522 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.958525 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:25.959516 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:25.959551 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.960509 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.960513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:25.960629 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:25.961233 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:25.961253 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:25.962087 (+ 834us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:25.965674 (+ 3587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:25.965678 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:25.965684 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:25.966219 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:25.966608 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:25.966612 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:25.966620 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:25.966803 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:25.967336 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:25.967341 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:25.967588 (+ 247us) client_negotiation.cc:769] Sending connection context
0809 06:32:25.967814 (+ 226us) client_negotiation.cc:240] Negotiation successful
0809 06:32:25.968211 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":653,"threads_started":1}
I20260809 06:32:25.969921 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:25.955259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:33115 (local address 127.30.78.126:33933)
0809 06:32:25.955430 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:25.955436 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:25.955618 (+ 182us) server_negotiation.cc:407] Connection header received
0809 06:32:25.955871 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:25.955875 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:25.955936 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:25.956005 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:25.957185 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.958392 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.959674 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:25.960334 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:25.960471 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:25.962290 (+ 1819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:25.962298 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:25.962303 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:25.962342 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:25.965558 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:25.966333 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:25.966338 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:25.966341 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:25.966480 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:25.966941 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:25.966947 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:25.966951 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:25.967224 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:25.967387 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:25.969333 (+ 1946us) server_negotiation.cc:299] Negotiation successful
0809 06:32:25.969580 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:32:25.974248 10032 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:35159
I20260809 06:32:25.974291 10229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:35159 every 8 connection(s)
I20260809 06:32:25.975425 10032 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:25.977185 10230 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33933
I20260809 06:32:25.977375 10230 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:25.977811 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 10032
I20260809 06:32:25.977989 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:32:25.978029 10230 heartbeater.cc:511] Master 127.30.78.126:33933 requested a full tablet report, sending...
I20260809 06:32:25.978688 31033 external_mini_cluster.cc:1428] Setting key cfb9dfcdd7920c73d07156274b742e9c
I20260809 06:32:25.980110 9922 ts_manager.cc:194] Registered new tserver with Master: bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159)
I20260809 06:32:25.981994 9922 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:51135
WARNING: no policy specified for oryx/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab.
Entry for principal oryx/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab.
I20260809 06:32:26.024398 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33933
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab
--principal=oryx/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:26.342108 10235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:26.342375 10235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:26.342515 10235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:26.349382 10235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:26.349494 10235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:26.349622 10235 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:32:26.349753 10235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:26.359109 10235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab
--principal=oryx/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.78.126:33933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:26.360337 10235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:26.361615 10235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:26.374085 10249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:26.374306 10248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:26.375414 10251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:26.376024 10235 server_base.cc:1034] running on GCE node
I20260809 06:32:26.376607 10235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:26.377517 10235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:26.378743 10235 hybrid_clock.cc:648] HybridClock initialized: now 1786257146378674 us; error 46 us; skew 500 ppm
I20260809 06:32:26.379019 10235 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:26 dist-test-slave-cvwc krb5kdc[9863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257146, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:26.382252 10235 init.cc:377] Logged in from keytab as oryx/127.30.78.66@KRBTEST.COM (short username oryx)
I20260809 06:32:26.383811 10235 webserver.cc:460] Webserver started at http://127.30.78.66:45285/ using document root <none> and password file <none>
I20260809 06:32:26.384614 10235 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:26.384717 10235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:26.385057 10235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:26.388126 10235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "0c2a7db6cdae43b98cf081f6b90b8c39"
format_stamp: "Formatted at 2026-08-09 06:32:26 on dist-test-slave-cvwc"
server_key: "aee301ecf92655777d19a0d608f9d98b"
server_key_iv: "e1ad19c29d5fd8f69aae2822db82728a"
server_key_version: "encryptionkey@0"
I20260809 06:32:26.388829 10235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "0c2a7db6cdae43b98cf081f6b90b8c39"
format_stamp: "Formatted at 2026-08-09 06:32:26 on dist-test-slave-cvwc"
server_key: "aee301ecf92655777d19a0d608f9d98b"
server_key_iv: "e1ad19c29d5fd8f69aae2822db82728a"
server_key_version: "encryptionkey@0"
I20260809 06:32:26.393599 10235 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 06:32:26.396747 10259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:26.398064 10235 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:32:26.398213 10235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "0c2a7db6cdae43b98cf081f6b90b8c39"
format_stamp: "Formatted at 2026-08-09 06:32:26 on dist-test-slave-cvwc"
server_key: "aee301ecf92655777d19a0d608f9d98b"
server_key_iv: "e1ad19c29d5fd8f69aae2822db82728a"
server_key_version: "encryptionkey@0"
I20260809 06:32:26.398398 10235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:26.441363 10235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:26.444887 10235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:26.445128 10235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:26.447582 10235 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:26.447690 10235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:26.447832 10235 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:26.447911 10235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:32:26 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257146, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:26.470005 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:26.449513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:37037 (local address 127.30.78.126:33933)
0809 06:32:26.449739 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:26.449746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:26.449865 (+ 119us) server_negotiation.cc:407] Connection header received
0809 06:32:26.452037 (+ 2172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:26.452043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:26.452118 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:26.452220 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:26.454525 (+ 2305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.455455 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.458225 (+ 2770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.458770 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.458905 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:26.463316 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:26.463323 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:26.463327 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:26.463371 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:26.466683 (+ 3312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:26.467635 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:26.467641 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:26.467646 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:26.467768 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:26.468201 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:26.468207 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:26.468210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:26.468507 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:26.468637 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:26.469423 (+ 786us) server_negotiation.cc:299] Negotiation successful
0809 06:32:26.469651 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 06:32:26.471336 10272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:26.448876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33933 (local address 127.30.78.66:37037)
0809 06:32:26.449696 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:26.449771 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:26.451739 (+ 1968us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:26.452513 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:26.452525 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:26.453352 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:26.454314 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:26.454341 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.455618 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.455623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:26.458085 (+ 2462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:26.458101 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.459025 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.459033 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:26.459348 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:26.460040 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:26.460076 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:26.463050 (+ 2974us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:26.466806 (+ 3756us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:26.466818 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:26.466832 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:26.467508 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:26.467879 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:26.467884 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:26.467888 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:26.468084 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:26.468637 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:26.468646 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:26.468986 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 06:32:26.469275 (+ 289us) client_negotiation.cc:240] Negotiation successful
0809 06:32:26.469786 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":619,"threads_started":1}
I20260809 06:32:26.491278 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:26.477401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:50321 (local address 127.30.78.126:33933)
0809 06:32:26.477531 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:26.477535 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:26.478287 (+ 752us) server_negotiation.cc:407] Connection header received
0809 06:32:26.478453 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:26.478471 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:26.478546 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:26.478638 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:26.479863 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.480575 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.482719 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.483225 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.483353 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:26.485571 (+ 2218us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:26.485575 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:26.485579 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:26.485607 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:26.488359 (+ 2752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:26.489161 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:26.489167 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:26.489171 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:26.489332 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:26.489898 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:26.489903 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:26.489907 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:26.490254 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:26.490366 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:26.490862 (+ 496us) server_negotiation.cc:299] Negotiation successful
0809 06:32:26.491036 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 06:32:26.491591 10388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:26.477523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33933 (local address 127.30.78.66:50321)
0809 06:32:26.478195 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:26.478211 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:26.478330 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:26.478698 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:26.478703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:26.479316 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:26.479734 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:26.479747 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.480690 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.480695 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:26.482503 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:26.482523 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.483436 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.483443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:26.483631 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:26.484312 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:26.484335 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:26.485400 (+ 1065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:26.488492 (+ 3092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:26.488497 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:26.488504 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:26.489039 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:26.489549 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:26.489554 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:26.489557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:26.489769 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:26.490368 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:26.490374 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:26.490612 (+ 238us) client_negotiation.cc:769] Sending connection context
0809 06:32:26.490764 (+ 152us) client_negotiation.cc:240] Negotiation successful
0809 06:32:26.491106 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":399,"threads_started":1}
I20260809 06:32:26.498835 10235 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:42515
I20260809 06:32:26.498878 10437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:42515 every 8 connection(s)
I20260809 06:32:26.499929 10235 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:26.501700 10438 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33933
I20260809 06:32:26.501930 10438 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:26.502513 10438 heartbeater.cc:511] Master 127.30.78.126:33933 requested a full tablet report, sending...
I20260809 06:32:26.502764 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 10235
I20260809 06:32:26.502918 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:32:26.503450 31033 external_mini_cluster.cc:1428] Setting key 84c92bc6d30c7f5d57338afc22d3f3a1
I20260809 06:32:26.503788 9922 ts_manager.cc:194] Registered new tserver with Master: 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515)
I20260809 06:32:26.504648 9922 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:37037
WARNING: no policy specified for oryx/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab.
Entry for principal oryx/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab.
I20260809 06:32:26.548884 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33933
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab
--principal=oryx/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:26.870800 10443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:26.871057 10443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:26.871196 10443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:26.878387 10443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:26.878506 10443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:26.878628 10443 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260809 06:32:26.878731 10443 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:26.888288 10443 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab
--principal=oryx/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.78.126:33933
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:26.889456 10443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:26.890738 10443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:26.903005 10449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:26.903048 10450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:26.903083 10455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:26.903916 10443 server_base.cc:1034] running on GCE node
I20260809 06:32:26.904464 10443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:26.905282 10443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:26.906484 10443 hybrid_clock.cc:648] HybridClock initialized: now 1786257146906418 us; error 37 us; skew 500 ppm
I20260809 06:32:26.906750 10443 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:26 dist-test-slave-cvwc krb5kdc[9863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257146, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:26.909667 10443 init.cc:377] Logged in from keytab as oryx/127.30.78.67@KRBTEST.COM (short username oryx)
I20260809 06:32:26.911140 10443 webserver.cc:460] Webserver started at http://127.30.78.67:35843/ using document root <none> and password file <none>
I20260809 06:32:26.911764 10443 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:26.911861 10443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:26.912168 10443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:26.914968 10443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "e6208e680b1042c98274a25cde68081e"
format_stamp: "Formatted at 2026-08-09 06:32:26 on dist-test-slave-cvwc"
server_key: "126c60e410199085aa2a3a2f004aa5b0"
server_key_iv: "3fe5bb0fa54e41d74ac2e3853746a04c"
server_key_version: "encryptionkey@0"
I20260809 06:32:26.915756 10443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "e6208e680b1042c98274a25cde68081e"
format_stamp: "Formatted at 2026-08-09 06:32:26 on dist-test-slave-cvwc"
server_key: "126c60e410199085aa2a3a2f004aa5b0"
server_key_iv: "3fe5bb0fa54e41d74ac2e3853746a04c"
server_key_version: "encryptionkey@0"
I20260809 06:32:26.920488 10443 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:32:26.923641 10469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:26.924825 10443 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:26.924968 10443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "e6208e680b1042c98274a25cde68081e"
format_stamp: "Formatted at 2026-08-09 06:32:26 on dist-test-slave-cvwc"
server_key: "126c60e410199085aa2a3a2f004aa5b0"
server_key_iv: "3fe5bb0fa54e41d74ac2e3853746a04c"
server_key_version: "encryptionkey@0"
I20260809 06:32:26.925155 10443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:26.945233 10443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:26.948673 10443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:26.948906 10443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:26.951526 10443 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:26.951611 10443 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:26.951771 10443 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:26.951851 10443 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:32:26 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257146, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:26.972618 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:26.951905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:36939 (local address 127.30.78.126:33933)
0809 06:32:26.952099 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:26.952105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:26.953372 (+ 1267us) server_negotiation.cc:407] Connection header received
0809 06:32:26.955355 (+ 1983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:26.955361 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:26.955453 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:26.955573 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:26.957895 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.958883 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.961339 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.961788 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.961926 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:26.966199 (+ 4273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:26.966205 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:26.966210 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:26.966251 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:26.969134 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:26.970112 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:26.970119 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:26.970123 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:26.970300 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:26.970733 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:26.970738 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:26.970742 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:26.971132 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:26.971290 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:26.971978 (+ 688us) server_negotiation.cc:299] Negotiation successful
0809 06:32:26.972233 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:32:26.973860 10482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:26.952333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33933 (local address 127.30.78.67:36939)
0809 06:32:26.953185 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:26.953239 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:26.955090 (+ 1851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:26.955866 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:26.955877 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:26.956858 (+ 981us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:26.957687 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:26.957738 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.959051 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.959057 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:26.961190 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:26.961203 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.962213 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.962218 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:26.962451 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:26.963172 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:26.963216 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:26.965976 (+ 2760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:26.969271 (+ 3295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:26.969281 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:26.969296 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:26.969961 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:26.970425 (+ 464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:26.970429 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:26.970434 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:26.970627 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:26.971239 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:26.971244 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:26.971566 (+ 322us) client_negotiation.cc:769] Sending connection context
0809 06:32:26.971779 (+ 213us) client_negotiation.cc:240] Negotiation successful
0809 06:32:26.972280 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":362,"threads_started":1}
I20260809 06:32:26.984629 10230 heartbeater.cc:503] Master 127.30.78.126:33933 was elected leader, sending a full tablet report...
I20260809 06:32:26.993348 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:26.980054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:58907 (local address 127.30.78.126:33933)
0809 06:32:26.980219 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:26.980223 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:26.980881 (+ 658us) server_negotiation.cc:407] Connection header received
0809 06:32:26.981064 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:26.981070 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:26.981134 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:26.981209 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:26.982320 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.983404 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.984844 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.985356 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.985470 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:26.987886 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:26.987892 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:26.987895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:26.987924 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:26.990900 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:26.991517 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:26.991523 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:26.991526 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:26.991650 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:26.992015 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:26.992020 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:26.992024 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:26.992281 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:26.992411 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:26.992802 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 06:32:26.993024 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:32:26.993439 10563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:26.980113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33933 (local address 127.30.78.67:58907)
0809 06:32:26.980761 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:26.980782 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:26.980939 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:26.981255 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:26.981260 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:26.981704 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:26.982141 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:26.982157 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.983552 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.983558 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:26.984641 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:26.984653 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:26.985540 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:26.985548 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:26.985763 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:26.986624 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:26.986649 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:26.987696 (+ 1047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:26.991029 (+ 3333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:26.991034 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:26.991039 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:26.991409 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:26.991764 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:26.991769 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:26.991773 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:26.991914 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:26.992401 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:26.992405 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:26.992568 (+ 163us) client_negotiation.cc:769] Sending connection context
0809 06:32:26.992691 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 06:32:26.993004 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":330,"threads_started":1}
I20260809 06:32:27.007354 10443 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:46331
I20260809 06:32:27.007417 10638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:46331 every 8 connection(s)
I20260809 06:32:27.008579 10443 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:27.010439 10639 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33933
I20260809 06:32:27.010622 10639 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:27.011211 10639 heartbeater.cc:511] Master 127.30.78.126:33933 requested a full tablet report, sending...
I20260809 06:32:27.012405 9922 ts_manager.cc:194] Registered new tserver with Master: e6208e680b1042c98274a25cde68081e (127.30.78.67:46331)
I20260809 06:32:27.013242 9922 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:36939
I20260809 06:32:27.017230 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 10443
I20260809 06:32:27.017390 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:32:27.017856 31033 external_mini_cluster.cc:1428] Setting key 38464ace3a33baaf800010052a608f9a
I20260809 06:32:27.020366 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 09 06:32:27 dist-test-slave-cvwc krb5kdc[9863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257147, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 09 06:32:27 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:27 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:27.506827 10438 heartbeater.cc:503] Master 127.30.78.126:33933 was elected leader, sending a full tablet report...
I20260809 06:32:28.015434 10639 heartbeater.cc:503] Master 127.30.78.126:33933 was elected leader, sending a full tablet report...
W20260809 06:32:28.170181 10651 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.105s user 0.003s sys 0.013s
W20260809 06:32:28.171388 10068 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:27.059890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58644 (local address 127.30.78.126:33933)
0809 06:32:27.060142 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:27.060150 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:27.060279 (+ 129us) server_negotiation.cc:407] Connection header received
0809 06:32:27.060440 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:27.060445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:27.060529 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:27.060642 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:27.061951 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:27.062674 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:27.063792 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:27.064205 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:27.064290 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.171128 (+1106838us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58644: BlockingRecv error: recv got EOF from 127.0.0.1:58644 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 09 06:32:28 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257147, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:28.190748 10068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.175404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58648 (local address 127.30.78.126:33933)
0809 06:32:28.175621 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:28.175628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:28.175817 (+ 189us) server_negotiation.cc:407] Connection header received
0809 06:32:28.175986 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:28.175990 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:28.176086 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:28.176167 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:28.177395 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.178144 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.179352 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.179730 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.179813 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.186326 (+ 6513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:28.186331 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:28.186335 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:28.186377 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:28.188623 (+ 2246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:28.189157 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:28.189161 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:28.189163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:28.189270 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:28.189573 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:28.189576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:28.189578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:28.189878 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:28.190095 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:28.190270 (+ 175us) server_negotiation.cc:299] Negotiation successful
0809 06:32:28.190455 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:32:28.194396 9922 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:32:28.201265 9922 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:32:28.224143 10671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.213224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:46331 (local address 127.0.0.1:36008)
0809 06:32:28.215590 (+ 2366us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:28.215633 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:28.215826 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:28.217319 (+ 1493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:28.217325 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:28.217357 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:28.217657 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.217666 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.219476 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.219482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.221513 (+ 2031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.221525 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.223069 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.223075 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.223257 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.223322 (+ 65us) client_negotiation.cc:769] Sending connection context
0809 06:32:28.223481 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 06:32:28.223669 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2156,"mutex_wait_us":21,"spinlock_wait_cycles":11520,"thread_start_us":1111,"threads_started":1}
I20260809 06:32:28.225075 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.214001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36008 (local address 127.30.78.67:46331)
0809 06:32:28.216710 (+ 2709us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:28.216719 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:28.216748 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:32:28.216853 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:28.216861 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:28.217102 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:28.217293 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:28.217838 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.219300 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.221659 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.222865 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.223014 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.223228 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:28.224626 (+ 1398us) server_negotiation.cc:299] Negotiation successful
0809 06:32:28.224795 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2575,"thread_start_us":2460,"threads_started":1}
I20260809 06:32:28.225654 10667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.213164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:35159 (local address 127.0.0.1:55114)
0809 06:32:28.215592 (+ 2428us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:28.215634 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:28.215827 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:28.218482 (+ 2655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:28.218487 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:28.218513 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:28.219001 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.219015 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.220837 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.220842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.222784 (+ 1942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.222797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.224862 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.224878 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.225039 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.225073 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:32:28.225159 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 06:32:28.225283 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2123,"mutex_wait_us":3,"spinlock_wait_cycles":4352,"thread_start_us":5639,"threads_started":1}
I20260809 06:32:28.226344 10668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.213613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55114 (local address 127.30.78.65:35159)
0809 06:32:28.217896 (+ 4283us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:28.217905 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:28.217935 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:32:28.218031 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:28.218040 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:28.218264 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:28.218479 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:28.219206 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.220703 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.222948 (+ 2245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.224660 (+ 1712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.224793 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.224999 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:28.225906 (+ 907us) server_negotiation.cc:299] Negotiation successful
0809 06:32:28.226069 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4131,"thread_start_us":3963,"threads_started":1}
I20260809 06:32:28.227068 10666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.214410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:42515 (local address 127.0.0.1:47800)
0809 06:32:28.219093 (+ 4683us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:28.219112 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:28.219305 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:28.220117 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:28.220121 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:28.220146 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:28.220497 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.220508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.222355 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.222361 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.224344 (+ 1983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.224359 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.226381 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.226387 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.226545 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.226573 (+ 28us) client_negotiation.cc:769] Sending connection context
0809 06:32:28.226652 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 06:32:28.226767 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4569,"thread_start_us":674,"threads_started":1}
I20260809 06:32:28.227152 10673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.214863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47800 (local address 127.30.78.66:42515)
0809 06:32:28.216308 (+ 1445us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:28.216316 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:28.219203 (+ 2887us) server_negotiation.cc:407] Connection header received
0809 06:32:28.219508 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:28.219516 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:28.219726 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:28.219880 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:28.220665 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.222209 (+ 1544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.224518 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.225928 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.226052 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.226237 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:28.226714 (+ 477us) server_negotiation.cc:299] Negotiation successful
0809 06:32:28.226889 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1281,"thread_start_us":1313,"threads_started":1}
I20260809 06:32:28.229817 10540 tablet_service.cc:1467] Processing CreateTablet for tablet 4db26b3e2c664cf0b57c72eb063568d8 (DEFAULT_TABLE table=test-table [id=bf1eecba53944721b18f9f187186a7d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:28.230441 10331 tablet_service.cc:1467] Processing CreateTablet for tablet 4db26b3e2c664cf0b57c72eb063568d8 (DEFAULT_TABLE table=test-table [id=bf1eecba53944721b18f9f187186a7d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:28.231367 10540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db26b3e2c664cf0b57c72eb063568d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:28.231570 10331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db26b3e2c664cf0b57c72eb063568d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:28.231861 10130 tablet_service.cc:1467] Processing CreateTablet for tablet 4db26b3e2c664cf0b57c72eb063568d8 (DEFAULT_TABLE table=test-table [id=bf1eecba53944721b18f9f187186a7d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:28.233134 10130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4db26b3e2c664cf0b57c72eb063568d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:28.243333 10676 tablet_bootstrap.cc:492] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: Bootstrap starting.
I20260809 06:32:28.246344 10676 tablet_bootstrap.cc:654] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:28.247295 10676 log.cc:824] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:28.248131 10678 tablet_bootstrap.cc:492] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: Bootstrap starting.
I20260809 06:32:28.250429 10681 tablet_bootstrap.cc:492] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: Bootstrap starting.
I20260809 06:32:28.251880 10678 tablet_bootstrap.cc:654] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:28.253182 10681 tablet_bootstrap.cc:654] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:28.253260 10678 log.cc:824] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:28.254338 10681 log.cc:824] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:28.256210 10676 tablet_bootstrap.cc:492] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: No bootstrap required, opened a new log
I20260809 06:32:28.256390 10678 tablet_bootstrap.cc:492] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: No bootstrap required, opened a new log
I20260809 06:32:28.256477 10676 ts_tablet_manager.cc:1397] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260809 06:32:28.256664 10678 ts_tablet_manager.cc:1397] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.006s
I20260809 06:32:28.257200 10681 tablet_bootstrap.cc:492] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: No bootstrap required, opened a new log
I20260809 06:32:28.257457 10681 ts_tablet_manager.cc:1397] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 06:32:28.263877 10676 raft_consensus.cc:348] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } }
I20260809 06:32:28.264211 10676 raft_consensus.cc:374] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:28.264303 10676 raft_consensus.cc:729] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a7db6cdae43b98cf081f6b90b8c39, State: Initialized, Role: FOLLOWER
I20260809 06:32:28.264865 10676 consensus_queue.cc:260] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } }
I20260809 06:32:28.266348 10676 ts_tablet_manager.cc:1428] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent starting tablet: real 0.010s user 0.010s sys 0.001s
I20260809 06:32:28.267320 10681 raft_consensus.cc:348] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } }
I20260809 06:32:28.267690 10681 raft_consensus.cc:374] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:28.267786 10681 raft_consensus.cc:729] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3ce8feb4564684963b7ad1a0d024e8, State: Initialized, Role: FOLLOWER
I20260809 06:32:28.267786 10678 raft_consensus.cc:348] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } }
I20260809 06:32:28.268190 10678 raft_consensus.cc:374] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:28.268296 10678 raft_consensus.cc:729] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6208e680b1042c98274a25cde68081e, State: Initialized, Role: FOLLOWER
I20260809 06:32:28.268337 10681 consensus_queue.cc:260] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } }
I20260809 06:32:28.268834 10678 consensus_queue.cc:260] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } }
I20260809 06:32:28.270017 10681 ts_tablet_manager.cc:1428] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: Time spent starting tablet: real 0.012s user 0.010s sys 0.005s
I20260809 06:32:28.272276 10678 ts_tablet_manager.cc:1428] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
I20260809 06:32:28.385347 10687 raft_consensus.cc:482] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:28.385617 10687 raft_consensus.cc:504] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } }
I20260809 06:32:28.387247 10687 leader_election.cc:288] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159), e6208e680b1042c98274a25cde68081e (127.30.78.67:46331)
I20260809 06:32:28.393730 10669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.387694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:47179 (local address 127.30.78.67:46331)
0809 06:32:28.387905 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:28.387911 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:28.388598 (+ 687us) server_negotiation.cc:407] Connection header received
0809 06:32:28.388783 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:28.388787 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:28.388859 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:28.388943 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:28.389512 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.390302 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.392163 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.392889 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.393028 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.393102 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:28.393369 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 06:32:28.393485 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:32:28.393805 10668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.387778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:38607 (local address 127.30.78.65:35159)
0809 06:32:28.387987 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:28.387994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:28.388673 (+ 679us) server_negotiation.cc:407] Connection header received
0809 06:32:28.388831 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:28.388835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:28.388914 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:28.388989 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:28.389604 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.390423 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.392202 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.392952 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.393094 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.393165 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:28.393436 (+ 271us) server_negotiation.cc:299] Negotiation successful
0809 06:32:28.393556 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:32:28.394086 10691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.387605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:46331 (local address 127.30.78.66:47179)
0809 06:32:28.388489 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:28.388506 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:28.388648 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:28.388970 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:28.388974 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:28.388997 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:28.389360 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.389377 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.390425 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.390430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.392004 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.392019 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.393085 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.393091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.393223 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.393246 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 06:32:28.393325 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 06:32:28.393453 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"thread_start_us":523,"threads_started":1}
I20260809 06:32:28.394129 10692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.387663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:35159 (local address 127.30.78.66:38607)
0809 06:32:28.388564 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:28.388579 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:28.388706 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:28.389015 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:28.389019 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:28.389042 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:28.389454 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.389464 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.390557 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.390561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.392049 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.392061 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.393172 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.393178 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.393294 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.393316 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 06:32:28.393404 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 06:32:28.393518 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"mutex_wait_us":3,"thread_start_us":569,"threads_started":1}
I20260809 06:32:28.394995 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db26b3e2c664cf0b57c72eb063568d8" candidate_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6208e680b1042c98274a25cde68081e" is_pre_election: true
I20260809 06:32:28.395011 10165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db26b3e2c664cf0b57c72eb063568d8" candidate_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" is_pre_election: true
I20260809 06:32:28.395442 10577 raft_consensus.cc:2454] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2a7db6cdae43b98cf081f6b90b8c39 in term 0.
I20260809 06:32:28.395444 10165 raft_consensus.cc:2454] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2a7db6cdae43b98cf081f6b90b8c39 in term 0.
I20260809 06:32:28.395998 10261 leader_election.cc:302] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a7db6cdae43b98cf081f6b90b8c39, e6208e680b1042c98274a25cde68081e; no voters:
I20260809 06:32:28.396332 10687 raft_consensus.cc:2781] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:32:28.396477 10687 raft_consensus.cc:482] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:28.396584 10687 raft_consensus.cc:3037] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:28.398804 10687 raft_consensus.cc:504] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } }
I20260809 06:32:28.399385 10687 leader_election.cc:288] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [CANDIDATE]: Term 1 election: Requested vote from peers bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159), e6208e680b1042c98274a25cde68081e (127.30.78.67:46331)
I20260809 06:32:28.399739 10165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db26b3e2c664cf0b57c72eb063568d8" candidate_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3ce8feb4564684963b7ad1a0d024e8"
I20260809 06:32:28.399829 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4db26b3e2c664cf0b57c72eb063568d8" candidate_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6208e680b1042c98274a25cde68081e"
I20260809 06:32:28.399945 10165 raft_consensus.cc:3037] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:28.400022 10577 raft_consensus.cc:3037] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:28.402223 10165 raft_consensus.cc:2454] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a7db6cdae43b98cf081f6b90b8c39 in term 1.
I20260809 06:32:28.402258 10577 raft_consensus.cc:2454] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a7db6cdae43b98cf081f6b90b8c39 in term 1.
I20260809 06:32:28.402628 10263 leader_election.cc:302] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a7db6cdae43b98cf081f6b90b8c39, bb3ce8feb4564684963b7ad1a0d024e8; no voters:
I20260809 06:32:28.402900 10687 raft_consensus.cc:2781] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:28.403273 10687 raft_consensus.cc:686] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 LEADER]: Becoming Leader. State: Replica: 0c2a7db6cdae43b98cf081f6b90b8c39, State: Running, Role: LEADER
I20260809 06:32:28.403699 10687 consensus_queue.cc:237] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } }
I20260809 06:32:28.408016 9922 catalog_manager.cc:5495] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66). New cstate: current_term: 1 leader_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } health_report { overall_health: HEALTHY } } }
I20260809 06:32:28.456457 10673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.451913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47808 (local address 127.30.78.66:42515)
0809 06:32:28.452074 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:28.452078 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:28.452171 (+ 93us) server_negotiation.cc:407] Connection header received
0809 06:32:28.452350 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:28.452353 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:28.452458 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:28.452572 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:28.452845 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.453522 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.454745 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.455139 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.455230 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.455552 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:28.456045 (+ 493us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:28.456146 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:28.456185 (+ 39us) server_negotiation.cc:299] Negotiation successful
0809 06:32:28.456246 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 06:32:28.463956 10577 raft_consensus.cc:1261] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Refusing update from remote peer 0c2a7db6cdae43b98cf081f6b90b8c39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:28.464022 10165 raft_consensus.cc:1261] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c2a7db6cdae43b98cf081f6b90b8c39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:28.464872 10687 consensus_queue.cc:1035] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:28.465147 10694 consensus_queue.cc:1035] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:28.489980 9921 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:28.490278 9921 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:28.493767 9921 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c: Sending DeleteTablet for 3 replicas of tablet 4db26b3e2c664cf0b57c72eb063568d8
I20260809 06:32:28.494800 10540 tablet_service.cc:1514] Processing DeleteTablet for tablet 4db26b3e2c664cf0b57c72eb063568d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:28 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:36008
I20260809 06:32:28.494901 10130 tablet_service.cc:1514] Processing DeleteTablet for tablet 4db26b3e2c664cf0b57c72eb063568d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:28 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:55114
I20260809 06:32:28.495174 10331 tablet_service.cc:1514] Processing DeleteTablet for tablet 4db26b3e2c664cf0b57c72eb063568d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:28 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:47800
I20260809 06:32:28.500028 9921 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:32:28.500705 9921 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:32:28.512485 10129 tablet_service.cc:1467] Processing CreateTablet for tablet 43ee72ea2c5148f7957da01fb163fdce (DEFAULT_TABLE table=test-table [id=a7ce9d17819041558f4691f92485ea95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:28.513141 10129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43ee72ea2c5148f7957da01fb163fdce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:28.518575 10539 tablet_service.cc:1467] Processing CreateTablet for tablet 43ee72ea2c5148f7957da01fb163fdce (DEFAULT_TABLE table=test-table [id=a7ce9d17819041558f4691f92485ea95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:28.519225 10539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43ee72ea2c5148f7957da01fb163fdce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:28.521065 10716 tablet_replica.cc:330] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: stopping tablet replica
I20260809 06:32:28.521657 10717 tablet_replica.cc:330] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: stopping tablet replica
I20260809 06:32:28.522248 10716 raft_consensus.cc:2229] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:28.522523 10330 tablet_service.cc:1467] Processing CreateTablet for tablet 43ee72ea2c5148f7957da01fb163fdce (DEFAULT_TABLE table=test-table [id=a7ce9d17819041558f4691f92485ea95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:28.522781 10717 raft_consensus.cc:2229] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:32:28.523350 10716 raft_consensus.cc:2258] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:28.523165 10330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 43ee72ea2c5148f7957da01fb163fdce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:28.524150 10717 raft_consensus.cc:2258] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:28.530192 10717 ts_tablet_manager.cc:1905] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:28.531054 10676 tablet_bootstrap.cc:492] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: Bootstrap starting.
I20260809 06:32:28.532773 10676 tablet_bootstrap.cc:654] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:28.533363 10715 tablet_replica.cc:330] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: stopping tablet replica
I20260809 06:32:28.533573 10678 tablet_bootstrap.cc:492] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: Bootstrap starting.
I20260809 06:32:28.533975 10715 raft_consensus.cc:2229] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:28.535517 10681 tablet_bootstrap.cc:492] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: Bootstrap starting.
I20260809 06:32:28.535255 10678 tablet_bootstrap.cc:654] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:28.537156 10681 tablet_bootstrap.cc:654] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:28.540186 10715 raft_consensus.cc:2258] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:28.543824 10715 ts_tablet_manager.cc:1905] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:28.548076 10716 ts_tablet_manager.cc:1905] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:28.556978 10681 tablet_bootstrap.cc:492] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: No bootstrap required, opened a new log
I20260809 06:32:28.557132 10681 ts_tablet_manager.cc:1397] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.008s
I20260809 06:32:28.557909 10678 tablet_bootstrap.cc:492] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: No bootstrap required, opened a new log
I20260809 06:32:28.558144 10678 ts_tablet_manager.cc:1397] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.000s
I20260809 06:32:28.558002 10681 raft_consensus.cc:348] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:28.558231 10681 raft_consensus.cc:374] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:28.558324 10681 raft_consensus.cc:729] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3ce8feb4564684963b7ad1a0d024e8, State: Initialized, Role: FOLLOWER
I20260809 06:32:28.558667 10681 consensus_queue.cc:260] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:28.559257 10678 raft_consensus.cc:348] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:28.559546 10678 raft_consensus.cc:374] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:28.559689 10678 raft_consensus.cc:729] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6208e680b1042c98274a25cde68081e, State: Initialized, Role: FOLLOWER
I20260809 06:32:28.560061 10678 consensus_queue.cc:260] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:28.561964 10678 ts_tablet_manager.cc:1428] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 06:32:28.563434 10681 ts_tablet_manager.cc:1428] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20260809 06:32:28.568648 10716 ts_tablet_manager.cc:1918] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:28.568801 10715 ts_tablet_manager.cc:1918] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:28.568835 10716 log.cc:1196] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/4db26b3e2c664cf0b57c72eb063568d8
I20260809 06:32:28.568969 10715 log.cc:1196] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/4db26b3e2c664cf0b57c72eb063568d8
I20260809 06:32:28.569379 10716 ts_tablet_manager.cc:1939] T 4db26b3e2c664cf0b57c72eb063568d8 P bb3ce8feb4564684963b7ad1a0d024e8: Deleting consensus metadata
I20260809 06:32:28.569450 10715 ts_tablet_manager.cc:1939] T 4db26b3e2c664cf0b57c72eb063568d8 P e6208e680b1042c98274a25cde68081e: Deleting consensus metadata
I20260809 06:32:28.571090 9902 catalog_manager.cc:4841] TS e6208e680b1042c98274a25cde68081e (127.30.78.67:46331): tablet 4db26b3e2c664cf0b57c72eb063568d8 (table test-table [id=bf1eecba53944721b18f9f187186a7d1]) successfully deleted
I20260809 06:32:28.571405 9904 catalog_manager.cc:4841] TS bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159): tablet 4db26b3e2c664cf0b57c72eb063568d8 (table test-table [id=bf1eecba53944721b18f9f187186a7d1]) successfully deleted
I20260809 06:32:28.571781 10717 ts_tablet_manager.cc:1918] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:28.571949 10717 log.cc:1196] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/4db26b3e2c664cf0b57c72eb063568d8
I20260809 06:32:28.572393 10717 ts_tablet_manager.cc:1939] T 4db26b3e2c664cf0b57c72eb063568d8 P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting consensus metadata
I20260809 06:32:28.574021 9905 catalog_manager.cc:4841] TS 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515): tablet 4db26b3e2c664cf0b57c72eb063568d8 (table test-table [id=bf1eecba53944721b18f9f187186a7d1]) successfully deleted
I20260809 06:32:28.574945 10676 tablet_bootstrap.cc:492] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: No bootstrap required, opened a new log
I20260809 06:32:28.575079 10676 ts_tablet_manager.cc:1397] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent bootstrapping tablet: real 0.044s user 0.021s sys 0.019s
I20260809 06:32:28.575798 10676 raft_consensus.cc:348] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:28.576006 10676 raft_consensus.cc:374] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:28.576103 10676 raft_consensus.cc:729] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a7db6cdae43b98cf081f6b90b8c39, State: Initialized, Role: FOLLOWER
I20260809 06:32:28.576362 10676 consensus_queue.cc:260] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:28.576884 10676 ts_tablet_manager.cc:1428] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20260809 06:32:28.729912 10231 tablet.cc:2369] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:32:28.753391 10439 tablet.cc:2369] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:32:28.762115 10640 tablet.cc:2369] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:32:28.924050 10690 raft_consensus.cc:482] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:28.924253 10690 raft_consensus.cc:504] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:28.925633 10690 leader_election.cc:288] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159), 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515)
I20260809 06:32:28.933415 10723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.926061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:52373 (local address 127.30.78.65:35159)
0809 06:32:28.927007 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:28.927013 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:28.927033 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:32:28.927110 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:28.927114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:28.927201 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:28.927293 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:28.927848 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.928938 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.931344 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.932482 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.932650 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.932722 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:28.932958 (+ 236us) server_negotiation.cc:299] Negotiation successful
0809 06:32:28.933070 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":659,"threads_started":1}
I20260809 06:32:28.933455 10721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.925968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:35159 (local address 127.30.78.67:52373)
0809 06:32:28.926702 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:28.926723 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:28.926858 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:28.927348 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:28.927352 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:28.927376 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:28.927679 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.927690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.929061 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.929065 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.931190 (+ 2125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.931207 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.932642 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.932646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.932776 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.932815 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 06:32:28.932914 (+ 99us) client_negotiation.cc:240] Negotiation successful
0809 06:32:28.933045 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"spinlock_wait_cycles":27392,"thread_start_us":982,"threads_started":1}
I20260809 06:32:28.933612 10673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.926049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:53641 (local address 127.30.78.66:42515)
0809 06:32:28.926234 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:28.926239 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:28.927309 (+ 1070us) server_negotiation.cc:407] Connection header received
0809 06:32:28.927454 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:28.927458 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:28.927515 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:28.927583 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:28.928187 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.929192 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.931527 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.932671 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.932806 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.932854 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:28.933233 (+ 379us) server_negotiation.cc:299] Negotiation successful
0809 06:32:28.933354 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:32:28.933905 10722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:28.925993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:42515 (local address 127.30.78.67:53641)
0809 06:32:28.927208 (+ 1215us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:28.927222 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:28.927334 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:28.927632 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:28.927637 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:28.927667 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:28.928033 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.928042 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.929333 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.929338 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.931389 (+ 2051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:28.931400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:28.932876 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:28.932883 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:28.933046 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:28.933075 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 06:32:28.933181 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 06:32:28.933292 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1129,"thread_start_us":403,"threads_started":1}
I20260809 06:32:28.934315 10165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43ee72ea2c5148f7957da01fb163fdce" candidate_uuid: "e6208e680b1042c98274a25cde68081e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" is_pre_election: true
I20260809 06:32:28.934547 10165 raft_consensus.cc:2454] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6208e680b1042c98274a25cde68081e in term 0.
I20260809 06:32:28.934638 10356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43ee72ea2c5148f7957da01fb163fdce" candidate_uuid: "e6208e680b1042c98274a25cde68081e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" is_pre_election: true
I20260809 06:32:28.934976 10356 raft_consensus.cc:2454] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6208e680b1042c98274a25cde68081e in term 0.
I20260809 06:32:28.934991 10474 leader_election.cc:302] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb3ce8feb4564684963b7ad1a0d024e8, e6208e680b1042c98274a25cde68081e; no voters:
I20260809 06:32:28.935379 10690 raft_consensus.cc:2781] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:32:28.935508 10690 raft_consensus.cc:482] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:28.935607 10690 raft_consensus.cc:3037] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:28.937736 10690 raft_consensus.cc:504] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:28.938284 10690 leader_election.cc:288] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [CANDIDATE]: Term 1 election: Requested vote from peers bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159), 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515)
I20260809 06:32:28.938709 10356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43ee72ea2c5148f7957da01fb163fdce" candidate_uuid: "e6208e680b1042c98274a25cde68081e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39"
I20260809 06:32:28.938711 10165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "43ee72ea2c5148f7957da01fb163fdce" candidate_uuid: "e6208e680b1042c98274a25cde68081e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3ce8feb4564684963b7ad1a0d024e8"
I20260809 06:32:28.938884 10356 raft_consensus.cc:3037] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:28.938892 10165 raft_consensus.cc:3037] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:28.940874 10165 raft_consensus.cc:2454] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6208e680b1042c98274a25cde68081e in term 1.
I20260809 06:32:28.940892 10356 raft_consensus.cc:2454] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6208e680b1042c98274a25cde68081e in term 1.
I20260809 06:32:28.941242 10475 leader_election.cc:302] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a7db6cdae43b98cf081f6b90b8c39, e6208e680b1042c98274a25cde68081e; no voters:
I20260809 06:32:28.941540 10690 raft_consensus.cc:2781] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:28.941962 10690 raft_consensus.cc:686] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 1 LEADER]: Becoming Leader. State: Replica: e6208e680b1042c98274a25cde68081e, State: Running, Role: LEADER
I20260809 06:32:28.942337 10690 consensus_queue.cc:237] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:28.945238 9921 catalog_manager.cc:5495] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e reported cstate change: term changed from 0 to 1, leader changed from <none> to e6208e680b1042c98274a25cde68081e (127.30.78.67). New cstate: current_term: 1 leader_uuid: "e6208e680b1042c98274a25cde68081e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } health_report { overall_health: HEALTHY } } }
Aug 09 06:32:29 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257145, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.126@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:29.042145 10736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.023816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33933 (local address 127.0.0.1:58650)
0809 06:32:29.024506 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:29.024521 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:29.024633 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:29.024903 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:29.024906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:29.025521 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:29.025743 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.025756 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.026736 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.026739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.027648 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.027658 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.028329 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.028333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.028465 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.035203 (+ 6738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:29.035224 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:29.037267 (+ 2043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:29.040054 (+ 2787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:29.040064 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:29.040069 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:29.040439 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:29.040723 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:29.040726 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:29.040728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:29.040849 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:29.041305 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:29.041310 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:29.041446 (+ 136us) client_negotiation.cc:769] Sending connection context
0809 06:32:29.041578 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 06:32:29.041803 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":577,"thread_start_us":349,"threads_started":1}
I20260809 06:32:29.042202 10735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.023839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58650 (local address 127.30.78.126:33933)
0809 06:32:29.024450 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.024455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.024592 (+ 137us) server_negotiation.cc:407] Connection header received
0809 06:32:29.024717 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.024721 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.024777 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.024863 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:29.025869 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.026616 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.027758 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.028188 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.028292 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.037448 (+ 9156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:29.037453 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:29.037456 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:29.037485 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:29.039947 (+ 2462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:29.040531 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:29.040535 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:29.040537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:29.040648 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:29.040941 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:29.040945 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:29.040947 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:29.041200 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:29.041320 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:29.041658 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 06:32:29.041923 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":462,"thread_start_us":292,"threads_started":1}
I20260809 06:32:29.046629 9921 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:58650:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260809 06:32:29.047545 9921 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:32:29.054010 10129 tablet_service.cc:1467] Processing CreateTablet for tablet e0c64ed977ad44858a6fe9b311b1ee82 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=006a10c85c7f4c33b028cf995a076534]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:32:29.054124 10331 tablet_service.cc:1467] Processing CreateTablet for tablet e0c64ed977ad44858a6fe9b311b1ee82 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=006a10c85c7f4c33b028cf995a076534]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:32:29.054600 10129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c64ed977ad44858a6fe9b311b1ee82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:29.054466 10539 tablet_service.cc:1467] Processing CreateTablet for tablet e0c64ed977ad44858a6fe9b311b1ee82 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=006a10c85c7f4c33b028cf995a076534]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260809 06:32:29.054718 10331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c64ed977ad44858a6fe9b311b1ee82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:29.054953 10539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0c64ed977ad44858a6fe9b311b1ee82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:29.060045 10676 tablet_bootstrap.cc:492] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: Bootstrap starting.
I20260809 06:32:29.061647 10676 tablet_bootstrap.cc:654] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:29.061681 10678 tablet_bootstrap.cc:492] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: Bootstrap starting.
I20260809 06:32:29.061790 10681 tablet_bootstrap.cc:492] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: Bootstrap starting.
I20260809 06:32:29.062999 10678 tablet_bootstrap.cc:654] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:29.063400 10681 tablet_bootstrap.cc:654] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:29.064962 10676 tablet_bootstrap.cc:492] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: No bootstrap required, opened a new log
I20260809 06:32:29.065125 10676 ts_tablet_manager.cc:1397] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 06:32:29.065310 10681 tablet_bootstrap.cc:492] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: No bootstrap required, opened a new log
I20260809 06:32:29.065467 10681 ts_tablet_manager.cc:1397] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260809 06:32:29.065784 10676 raft_consensus.cc:348] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.065984 10676 raft_consensus.cc:374] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:29.066058 10676 raft_consensus.cc:729] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a7db6cdae43b98cf081f6b90b8c39, State: Initialized, Role: FOLLOWER
I20260809 06:32:29.066059 10681 raft_consensus.cc:348] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.066282 10681 raft_consensus.cc:374] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:29.066356 10681 raft_consensus.cc:729] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3ce8feb4564684963b7ad1a0d024e8, State: Initialized, Role: FOLLOWER
I20260809 06:32:29.066272 10676 consensus_queue.cc:260] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.066828 10676 ts_tablet_manager.cc:1428] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 06:32:29.066685 10694 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.067016 10694 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:32:29.066617 10681 consensus_queue.cc:260] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.068001 10678 tablet_bootstrap.cc:492] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: No bootstrap required, opened a new log
I20260809 06:32:29.068162 10678 ts_tablet_manager.cc:1397] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260809 06:32:29.068883 10681 ts_tablet_manager.cc:1428] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260809 06:32:29.068751 10740 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.068835 10678 raft_consensus.cc:348] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.069021 10740 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:32:29.069070 10678 raft_consensus.cc:374] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:29.069128 10678 raft_consensus.cc:729] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6208e680b1042c98274a25cde68081e, State: Initialized, Role: FOLLOWER
I20260809 06:32:29.069293 10678 consensus_queue.cc:260] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.069618 10690 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.069810 10678 ts_tablet_manager.cc:1428] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:29.069878 10690 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:32:29.084482 10694 raft_consensus.cc:482] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:29.084635 10694 raft_consensus.cc:504] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.085215 10694 leader_election.cc:288] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159), e6208e680b1042c98274a25cde68081e (127.30.78.67:46331)
I20260809 06:32:29.085619 10165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c64ed977ad44858a6fe9b311b1ee82" candidate_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" is_pre_election: true
I20260809 06:32:29.085639 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c64ed977ad44858a6fe9b311b1ee82" candidate_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6208e680b1042c98274a25cde68081e" is_pre_election: true
I20260809 06:32:29.085846 10165 raft_consensus.cc:2454] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2a7db6cdae43b98cf081f6b90b8c39 in term 0.
I20260809 06:32:29.085881 10577 raft_consensus.cc:2454] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2a7db6cdae43b98cf081f6b90b8c39 in term 0.
I20260809 06:32:29.086186 10263 leader_election.cc:302] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a7db6cdae43b98cf081f6b90b8c39, bb3ce8feb4564684963b7ad1a0d024e8; no voters:
I20260809 06:32:29.086434 10694 raft_consensus.cc:2781] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:32:29.086519 10694 raft_consensus.cc:482] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:29.086614 10694 raft_consensus.cc:3037] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:29.088438 10694 raft_consensus.cc:504] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.088927 10694 leader_election.cc:288] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [CANDIDATE]: Term 1 election: Requested vote from peers bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159), e6208e680b1042c98274a25cde68081e (127.30.78.67:46331)
I20260809 06:32:29.089257 10165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c64ed977ad44858a6fe9b311b1ee82" candidate_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb3ce8feb4564684963b7ad1a0d024e8"
I20260809 06:32:29.089344 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0c64ed977ad44858a6fe9b311b1ee82" candidate_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6208e680b1042c98274a25cde68081e"
I20260809 06:32:29.089478 10165 raft_consensus.cc:3037] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:29.089498 10577 raft_consensus.cc:3037] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:29.091439 10165 raft_consensus.cc:2454] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a7db6cdae43b98cf081f6b90b8c39 in term 1.
I20260809 06:32:29.091583 10577 raft_consensus.cc:2454] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a7db6cdae43b98cf081f6b90b8c39 in term 1.
I20260809 06:32:29.091768 10263 leader_election.cc:302] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a7db6cdae43b98cf081f6b90b8c39, bb3ce8feb4564684963b7ad1a0d024e8; no voters:
I20260809 06:32:29.092010 10694 raft_consensus.cc:2781] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:29.092352 10694 raft_consensus.cc:686] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 LEADER]: Becoming Leader. State: Replica: 0c2a7db6cdae43b98cf081f6b90b8c39, State: Running, Role: LEADER
I20260809 06:32:29.092572 10694 consensus_queue.cc:237] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.094074 10741 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: TxnStatusTablet state changed. Reason: New leader 0c2a7db6cdae43b98cf081f6b90b8c39. Latest consensus state: current_term: 1 leader_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.094384 10741 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:32:29.094863 10744 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260809 06:32:29.095055 10744 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260809 06:32:29.094929 9918 catalog_manager.cc:5495] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66). New cstate: current_term: 1 leader_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } health_report { overall_health: UNKNOWN } } }
I20260809 06:32:29.116894 10673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.111167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47812 (local address 127.30.78.66:42515)
0809 06:32:29.111372 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.111379 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.111661 (+ 282us) server_negotiation.cc:407] Connection header received
0809 06:32:29.111904 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.111908 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.111980 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.112074 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:29.112433 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.113234 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.115224 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.115662 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.115757 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.116292 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:29.116384 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:29.116445 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:29.116594 (+ 149us) server_negotiation.cc:299] Negotiation successful
0809 06:32:29.116654 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:32:29.117130 10736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.111193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:42515 (local address 127.0.0.1:47812)
0809 06:32:29.111579 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:29.111595 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:29.111727 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:29.112117 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:29.112122 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:29.112134 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:32:29.112298 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.112306 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.113387 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.113394 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.115086 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.115102 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.115803 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.115810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.116015 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.116087 (+ 72us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:32:29.116476 (+ 389us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:32:29.116496 (+ 20us) client_negotiation.cc:769] Sending connection context
0809 06:32:29.116581 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 06:32:29.116739 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235}
I20260809 06:32:29.120833 10577 raft_consensus.cc:1261] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Refusing update from remote peer 0c2a7db6cdae43b98cf081f6b90b8c39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:29.120975 10165 raft_consensus.cc:1261] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Refusing update from remote peer 0c2a7db6cdae43b98cf081f6b90b8c39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:29.121451 10741 consensus_queue.cc:1035] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:29.121795 10694 consensus_queue.cc:1035] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:29.130576 10740 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: TxnStatusTablet state changed. Reason: New leader 0c2a7db6cdae43b98cf081f6b90b8c39. Latest consensus state: current_term: 1 leader_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.130890 10740 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:32:29.137866 10741 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.138131 10741 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:32:29.138863 10740 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.139094 10740 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P bb3ce8feb4564684963b7ad1a0d024e8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:32:29.145908 10724 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.146301 10724 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:32:29.153805 10690 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: TxnStatusTablet state changed. Reason: New leader 0c2a7db6cdae43b98cf081f6b90b8c39. Latest consensus state: current_term: 1 leader_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.154075 10690 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P e6208e680b1042c98274a25cde68081e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260809 06:32:29.154727 10741 tablet_replica.cc:439] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } } }
I20260809 06:32:29.154973 10741 tablet_replica.cc:442] T e0c64ed977ad44858a6fe9b311b1ee82 P 0c2a7db6cdae43b98cf081f6b90b8c39: This TxnStatusTablet replica's current role is: LEADER
I20260809 06:32:29.166512 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.158710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36022 (local address 127.30.78.67:46331)
0809 06:32:29.159259 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.159265 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.159549 (+ 284us) server_negotiation.cc:407] Connection header received
0809 06:32:29.159743 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.159746 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.159835 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.159967 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:29.160513 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.161278 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.163282 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.163936 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.164054 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.164687 (+ 633us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:29.165505 (+ 818us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:29.165666 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:29.166070 (+ 404us) server_negotiation.cc:299] Negotiation successful
0809 06:32:29.166154 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":285,"threads_started":1}
I20260809 06:32:29.186547 10673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.178076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:44049 (local address 127.30.78.66:42515)
0809 06:32:29.178262 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.178268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.178871 (+ 603us) server_negotiation.cc:407] Connection header received
0809 06:32:29.179097 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.179104 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.179194 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.179286 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:29.179843 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.181011 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.184152 (+ 3141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.184876 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.185007 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.185631 (+ 624us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:29.185836 (+ 205us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:29.185939 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:29.186123 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 06:32:29.186218 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:32:29.186594 10768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.178083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:42515 (local address 127.30.78.67:44049)
0809 06:32:29.178759 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:29.178779 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:29.178941 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:29.179313 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:29.179317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:29.179329 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:32:29.179677 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.179689 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.181156 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.181162 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.182816 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.182832 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.185082 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.185090 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.185281 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.185365 (+ 84us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:32:29.185953 (+ 588us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:32:29.185966 (+ 13us) client_negotiation.cc:769] Sending connection context
0809 06:32:29.186073 (+ 107us) client_negotiation.cc:240] Negotiation successful
0809 06:32:29.186217 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":323,"threads_started":1}
I20260809 06:32:29.196218 10165 raft_consensus.cc:1261] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Refusing update from remote peer e6208e680b1042c98274a25cde68081e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:29.196280 10356 raft_consensus.cc:1261] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Refusing update from remote peer e6208e680b1042c98274a25cde68081e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:29.196873 10724 consensus_queue.cc:1035] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:29.197201 10690 consensus_queue.cc:1035] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:29.202293 10750 mvcc.cc:205] Tried to move back new op lower bound from 7316509283100545024 to 7316509282070953984. Current Snapshot: MvccSnapshot[applied={T|T < 7316509283100545024}]
I20260809 06:32:29.238817 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.228909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:54133 (local address 127.30.78.67:46331)
0809 06:32:29.229079 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.229085 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.232414 (+ 3329us) server_negotiation.cc:407] Connection header received
0809 06:32:29.232619 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.232624 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.232699 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.232771 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:29.233358 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.234493 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.236662 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.237297 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.237397 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.238052 (+ 655us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:29.238173 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:29.238255 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:29.238406 (+ 151us) server_negotiation.cc:299] Negotiation successful
0809 06:32:29.238492 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:32:29.238947 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.229006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:46331 (local address 127.30.78.66:54133)
0809 06:32:29.232313 (+ 3307us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:29.232341 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:29.232493 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:29.232809 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:29.232814 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:29.232825 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:32:29.233196 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.233211 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.234663 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.234669 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.236491 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.236508 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.237562 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.237568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.237773 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.237846 (+ 73us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:32:29.238274 (+ 428us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:32:29.238286 (+ 12us) client_negotiation.cc:769] Sending connection context
0809 06:32:29.238361 (+ 75us) client_negotiation.cc:240] Negotiation successful
0809 06:32:29.238498 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3074,"thread_start_us":2881,"threads_started":1}
I20260809 06:32:29.282917 9918 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:29.283208 9918 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:29.286585 9918 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c: Sending DeleteTablet for 3 replicas of tablet 43ee72ea2c5148f7957da01fb163fdce
I20260809 06:32:29.287389 10129 tablet_service.cc:1514] Processing DeleteTablet for tablet 43ee72ea2c5148f7957da01fb163fdce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:29 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:55114
I20260809 06:32:29.288362 10331 tablet_service.cc:1514] Processing DeleteTablet for tablet 43ee72ea2c5148f7957da01fb163fdce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:29 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:47800
I20260809 06:32:29.289186 10539 tablet_service.cc:1514] Processing DeleteTablet for tablet 43ee72ea2c5148f7957da01fb163fdce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:29 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:36008
I20260809 06:32:29.299312 10785 tablet_replica.cc:330] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: stopping tablet replica
I20260809 06:32:29.299552 10785 raft_consensus.cc:2229] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:29.299839 10785 raft_consensus.cc:2258] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:29.301043 10785 ts_tablet_manager.cc:1905] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:29.309267 10785 ts_tablet_manager.cc:1918] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:32:29.309499 10785 log.cc:1196] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/43ee72ea2c5148f7957da01fb163fdce
I20260809 06:32:29.310153 10785 ts_tablet_manager.cc:1939] T 43ee72ea2c5148f7957da01fb163fdce P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting consensus metadata
I20260809 06:32:29.310236 10786 tablet_replica.cc:330] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: stopping tablet replica
I20260809 06:32:29.310485 10786 raft_consensus.cc:2229] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:32:29.310750 10784 tablet_replica.cc:330] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: stopping tablet replica
I20260809 06:32:29.311059 10784 raft_consensus.cc:2229] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:29.311170 10786 raft_consensus.cc:2258] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:29.311340 9905 catalog_manager.cc:4841] TS 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515): tablet 43ee72ea2c5148f7957da01fb163fdce (table test-table [id=a7ce9d17819041558f4691f92485ea95]) successfully deleted
I20260809 06:32:29.311554 10784 raft_consensus.cc:2258] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:29.312282 10786 ts_tablet_manager.cc:1905] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:29.312696 10784 ts_tablet_manager.cc:1905] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:29.319617 10784 ts_tablet_manager.cc:1918] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:32:29.319790 10784 log.cc:1196] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/43ee72ea2c5148f7957da01fb163fdce
I20260809 06:32:29.320282 10784 ts_tablet_manager.cc:1939] T 43ee72ea2c5148f7957da01fb163fdce P bb3ce8feb4564684963b7ad1a0d024e8: Deleting consensus metadata
I20260809 06:32:29.321322 9904 catalog_manager.cc:4841] TS bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159): tablet 43ee72ea2c5148f7957da01fb163fdce (table test-table [id=a7ce9d17819041558f4691f92485ea95]) successfully deleted
I20260809 06:32:29.323588 10786 ts_tablet_manager.cc:1918] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:32:29.323724 10786 log.cc:1196] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/43ee72ea2c5148f7957da01fb163fdce
I20260809 06:32:29.324225 10786 ts_tablet_manager.cc:1939] T 43ee72ea2c5148f7957da01fb163fdce P e6208e680b1042c98274a25cde68081e: Deleting consensus metadata
I20260809 06:32:29.325330 9902 catalog_manager.cc:4841] TS e6208e680b1042c98274a25cde68081e (127.30.78.67:46331): tablet 43ee72ea2c5148f7957da01fb163fdce (table test-table [id=a7ce9d17819041558f4691f92485ea95]) successfully deleted
Aug 09 06:32:29 dist-test-slave-cvwc krb5kdc[9863](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 09 06:32:29 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:29 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 06:32:29.378942 10735 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:29.365846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58660 (local address 127.30.78.126:33933)
0809 06:32:29.366017 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.366024 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.366483 (+ 459us) server_negotiation.cc:407] Connection header received
0809 06:32:29.366693 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.366699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.366788 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.366906 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:29.368530 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.369651 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.371526 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.372181 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.372271 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.378681 (+ 6410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58660: BlockingRecv error: recv got EOF from 127.0.0.1:58660 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 09 06:32:29 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM
I20260809 06:32:29.422622 10735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.404590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58662 (local address 127.30.78.126:33933)
0809 06:32:29.404760 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.404767 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.405319 (+ 552us) server_negotiation.cc:407] Connection header received
0809 06:32:29.405493 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.405499 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.405583 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.405687 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:29.407313 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.408421 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.410330 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.411093 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.411232 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.416050 (+ 4818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:29.416058 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:29.416063 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:29.416103 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:29.419547 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:29.420294 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:29.420300 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:29.420305 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:29.420494 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:29.420920 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:29.420925 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:29.420929 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:29.421268 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:29.421561 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:29.421845 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 06:32:29.422087 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:32:29.427029 9918 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:32:29.427767 9918 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:32:29.436136 10129 tablet_service.cc:1467] Processing CreateTablet for tablet 379aa8a8837d450ba8fcd4b941f9c9dd (DEFAULT_TABLE table=test-table [id=add1e6e9a7444bfab51b5eb7f68ada43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:29.436622 10129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 379aa8a8837d450ba8fcd4b941f9c9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:29.436542 10331 tablet_service.cc:1467] Processing CreateTablet for tablet 379aa8a8837d450ba8fcd4b941f9c9dd (DEFAULT_TABLE table=test-table [id=add1e6e9a7444bfab51b5eb7f68ada43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:29.436992 10331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 379aa8a8837d450ba8fcd4b941f9c9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:29.443475 10539 tablet_service.cc:1467] Processing CreateTablet for tablet 379aa8a8837d450ba8fcd4b941f9c9dd (DEFAULT_TABLE table=test-table [id=add1e6e9a7444bfab51b5eb7f68ada43]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:29.443929 10539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 379aa8a8837d450ba8fcd4b941f9c9dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:29.444916 10676 tablet_bootstrap.cc:492] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: Bootstrap starting.
I20260809 06:32:29.446691 10676 tablet_bootstrap.cc:654] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:29.452529 10681 tablet_bootstrap.cc:492] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: Bootstrap starting.
I20260809 06:32:29.454267 10681 tablet_bootstrap.cc:654] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:29.457744 10678 tablet_bootstrap.cc:492] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: Bootstrap starting.
I20260809 06:32:29.459458 10678 tablet_bootstrap.cc:654] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:29.460693 10676 tablet_bootstrap.cc:492] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: No bootstrap required, opened a new log
I20260809 06:32:29.460855 10676 ts_tablet_manager.cc:1397] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.009s
I20260809 06:32:29.461696 10676 raft_consensus.cc:348] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.462020 10676 raft_consensus.cc:374] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:29.462119 10676 raft_consensus.cc:729] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a7db6cdae43b98cf081f6b90b8c39, State: Initialized, Role: FOLLOWER
I20260809 06:32:29.462383 10676 consensus_queue.cc:260] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.463944 10676 ts_tablet_manager.cc:1428] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260809 06:32:29.466704 10678 tablet_bootstrap.cc:492] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: No bootstrap required, opened a new log
I20260809 06:32:29.466917 10678 ts_tablet_manager.cc:1397] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s
I20260809 06:32:29.467744 10678 raft_consensus.cc:348] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.468055 10678 raft_consensus.cc:374] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:29.468156 10678 raft_consensus.cc:729] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6208e680b1042c98274a25cde68081e, State: Initialized, Role: FOLLOWER
I20260809 06:32:29.468384 10678 consensus_queue.cc:260] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.469126 10678 ts_tablet_manager.cc:1428] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260809 06:32:29.473891 10681 tablet_bootstrap.cc:492] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: No bootstrap required, opened a new log
I20260809 06:32:29.474107 10681 ts_tablet_manager.cc:1397] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.002s
I20260809 06:32:29.474929 10681 raft_consensus.cc:348] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.475188 10681 raft_consensus.cc:374] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:29.475332 10681 raft_consensus.cc:729] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3ce8feb4564684963b7ad1a0d024e8, State: Initialized, Role: FOLLOWER
I20260809 06:32:29.475553 10681 consensus_queue.cc:260] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.476150 10681 ts_tablet_manager.cc:1428] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:29.580199 10740 raft_consensus.cc:482] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:29.580389 10740 raft_consensus.cc:504] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.581887 10740 leader_election.cc:288] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515), e6208e680b1042c98274a25cde68081e (127.30.78.67:46331)
I20260809 06:32:29.589335 10673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.582720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:32957 (local address 127.30.78.66:42515)
0809 06:32:29.582899 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.582905 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.582924 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:32:29.583204 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.583209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.583283 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.583349 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:29.584007 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.585059 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.587741 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.588500 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.588651 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.588724 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:29.588970 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 06:32:29.589099 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260809 06:32:29.589509 10811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.582122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:42515 (local address 127.30.78.65:32957)
0809 06:32:29.582637 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:29.582656 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:29.583000 (+ 344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:29.583536 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:29.583541 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:29.583564 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:29.583773 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.583784 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.585251 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.585256 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.587546 (+ 2290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.587561 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.588650 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.588656 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.588825 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.588850 (+ 25us) client_negotiation.cc:769] Sending connection context
0809 06:32:29.588932 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 06:32:29.589061 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":100,"thread_start_us":867,"threads_started":1}
I20260809 06:32:29.590137 10356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "379aa8a8837d450ba8fcd4b941f9c9dd" candidate_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" is_pre_election: true
I20260809 06:32:29.590399 10356 raft_consensus.cc:2454] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3ce8feb4564684963b7ad1a0d024e8 in term 0.
I20260809 06:32:29.590494 10765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.582445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:55963 (local address 127.30.78.67:46331)
0809 06:32:29.582655 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.582662 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.583374 (+ 712us) server_negotiation.cc:407] Connection header received
0809 06:32:29.583541 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.583546 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.583651 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.583749 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:32:29.584337 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.585107 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.587708 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.589023 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.589199 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.589285 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:29.590067 (+ 782us) server_negotiation.cc:299] Negotiation successful
0809 06:32:29.590206 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:32:29.590744 10812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.582161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:46331 (local address 127.30.78.65:55963)
0809 06:32:29.583274 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:29.583290 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:29.583406 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:29.583795 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:29.583799 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:29.583825 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:32:29.584178 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.584187 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.585255 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.585260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.587546 (+ 2286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:29.587561 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.589483 (+ 1922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.589489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:29.589887 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.589924 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:32:29.590025 (+ 101us) client_negotiation.cc:240] Negotiation successful
0809 06:32:29.590156 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1011,"mutex_wait_us":67,"thread_start_us":237,"threads_started":1}
I20260809 06:32:29.591050 10061 leader_election.cc:302] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a7db6cdae43b98cf081f6b90b8c39, bb3ce8feb4564684963b7ad1a0d024e8; no voters:
I20260809 06:32:29.591529 10740 raft_consensus.cc:2781] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:32:29.591660 10740 raft_consensus.cc:482] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:29.591782 10740 raft_consensus.cc:3037] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:29.591852 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "379aa8a8837d450ba8fcd4b941f9c9dd" candidate_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6208e680b1042c98274a25cde68081e" is_pre_election: true
I20260809 06:32:29.592101 10577 raft_consensus.cc:2454] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3ce8feb4564684963b7ad1a0d024e8 in term 0.
I20260809 06:32:29.594995 10740 raft_consensus.cc:504] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.595733 10740 leader_election.cc:288] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [CANDIDATE]: Term 1 election: Requested vote from peers 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515), e6208e680b1042c98274a25cde68081e (127.30.78.67:46331)
I20260809 06:32:29.596043 10356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "379aa8a8837d450ba8fcd4b941f9c9dd" candidate_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39"
I20260809 06:32:29.596223 10356 raft_consensus.cc:3037] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:29.596454 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "379aa8a8837d450ba8fcd4b941f9c9dd" candidate_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6208e680b1042c98274a25cde68081e"
I20260809 06:32:29.596638 10577 raft_consensus.cc:3037] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:29.599049 10356 raft_consensus.cc:2454] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb3ce8feb4564684963b7ad1a0d024e8 in term 1.
I20260809 06:32:29.599721 10061 leader_election.cc:302] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a7db6cdae43b98cf081f6b90b8c39, bb3ce8feb4564684963b7ad1a0d024e8; no voters:
I20260809 06:32:29.600015 10740 raft_consensus.cc:2781] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:29.600029 10577 raft_consensus.cc:2454] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb3ce8feb4564684963b7ad1a0d024e8 in term 1.
I20260809 06:32:29.600608 10740 raft_consensus.cc:686] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 LEADER]: Becoming Leader. State: Replica: bb3ce8feb4564684963b7ad1a0d024e8, State: Running, Role: LEADER
I20260809 06:32:29.601073 10740 consensus_queue.cc:237] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.605010 9921 catalog_manager.cc:5495] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65). New cstate: current_term: 1 leader_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } health_report { overall_health: UNKNOWN } } }
I20260809 06:32:29.646992 10818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:29.641429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55124 (local address 127.30.78.65:35159)
0809 06:32:29.642005 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:29.642009 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:29.642028 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:32:29.642107 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:29.642110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:29.642179 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:29.642322 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:29.642740 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.643500 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.644772 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:29.645201 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:29.645309 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:29.645805 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:29.646357 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:29.646496 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:29.646616 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 06:32:29.646692 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":337,"threads_started":1}
I20260809 06:32:29.650740 10577 raft_consensus.cc:1261] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Refusing update from remote peer bb3ce8feb4564684963b7ad1a0d024e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:29.650811 10356 raft_consensus.cc:1261] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Refusing update from remote peer bb3ce8feb4564684963b7ad1a0d024e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:29.651513 10813 consensus_queue.cc:1035] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:29.652315 10740 consensus_queue.cc:1035] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:29.657473 10751 mvcc.cc:205] Tried to move back new op lower bound from 7316509284961951744 to 7316509284770775040. Current Snapshot: MvccSnapshot[applied={T|T < 7316509284961951744}]
I20260809 06:32:29.675616 9921 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:29.675940 9921 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:29.679523 9921 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c: Sending DeleteTablet for 3 replicas of tablet 379aa8a8837d450ba8fcd4b941f9c9dd
I20260809 06:32:29.680455 10331 tablet_service.cc:1514] Processing DeleteTablet for tablet 379aa8a8837d450ba8fcd4b941f9c9dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:29 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:47800
I20260809 06:32:29.680482 10129 tablet_service.cc:1514] Processing DeleteTablet for tablet 379aa8a8837d450ba8fcd4b941f9c9dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:29 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:55114
I20260809 06:32:29.680747 10785 tablet_replica.cc:330] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: stopping tablet replica
I20260809 06:32:29.680797 10784 tablet_replica.cc:330] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: stopping tablet replica
I20260809 06:32:29.680953 10785 raft_consensus.cc:2229] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:29.681003 10784 raft_consensus.cc:2229] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:32:29.681173 10785 raft_consensus.cc:2258] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:29.681499 10784 raft_consensus.cc:2258] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:29.682294 10785 ts_tablet_manager.cc:1905] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:29.682546 10539 tablet_service.cc:1514] Processing DeleteTablet for tablet 379aa8a8837d450ba8fcd4b941f9c9dd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:29 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:36008
I20260809 06:32:29.682833 10786 tablet_replica.cc:330] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: stopping tablet replica
I20260809 06:32:29.683030 10786 raft_consensus.cc:2229] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:29.683252 10786 raft_consensus.cc:2258] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:29.684496 10786 ts_tablet_manager.cc:1905] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:29.687932 10785 ts_tablet_manager.cc:1918] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:29.688144 10785 log.cc:1196] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/379aa8a8837d450ba8fcd4b941f9c9dd
I20260809 06:32:29.688660 10785 ts_tablet_manager.cc:1939] T 379aa8a8837d450ba8fcd4b941f9c9dd P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting consensus metadata
I20260809 06:32:29.689857 9905 catalog_manager.cc:4841] TS 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515): tablet 379aa8a8837d450ba8fcd4b941f9c9dd (table test-table [id=add1e6e9a7444bfab51b5eb7f68ada43]) successfully deleted
I20260809 06:32:29.689890 10784 ts_tablet_manager.cc:1905] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:29.694274 9921 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260809 06:32:29.694569 10786 ts_tablet_manager.cc:1918] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:29.694718 10786 log.cc:1196] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/379aa8a8837d450ba8fcd4b941f9c9dd
W20260809 06:32:29.694952 9921 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:32:29.695173 10786 ts_tablet_manager.cc:1939] T 379aa8a8837d450ba8fcd4b941f9c9dd P e6208e680b1042c98274a25cde68081e: Deleting consensus metadata
I20260809 06:32:29.696274 9902 catalog_manager.cc:4841] TS e6208e680b1042c98274a25cde68081e (127.30.78.67:46331): tablet 379aa8a8837d450ba8fcd4b941f9c9dd (table test-table [id=add1e6e9a7444bfab51b5eb7f68ada43]) successfully deleted
I20260809 06:32:29.699550 10784 ts_tablet_manager.cc:1918] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:32:29.699746 10784 log.cc:1196] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/379aa8a8837d450ba8fcd4b941f9c9dd
I20260809 06:32:29.700214 10784 ts_tablet_manager.cc:1939] T 379aa8a8837d450ba8fcd4b941f9c9dd P bb3ce8feb4564684963b7ad1a0d024e8: Deleting consensus metadata
I20260809 06:32:29.701565 9904 catalog_manager.cc:4841] TS bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159): tablet 379aa8a8837d450ba8fcd4b941f9c9dd (table test-table [id=add1e6e9a7444bfab51b5eb7f68ada43]) successfully deleted
I20260809 06:32:29.704376 10539 tablet_service.cc:1467] Processing CreateTablet for tablet 9293fd4552504ce185e6815de0d9f76d (DEFAULT_TABLE table=test-table [id=92a263a5efc5428babd8fdb4d0d62755]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:29.704525 10331 tablet_service.cc:1467] Processing CreateTablet for tablet 9293fd4552504ce185e6815de0d9f76d (DEFAULT_TABLE table=test-table [id=92a263a5efc5428babd8fdb4d0d62755]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:29.704794 10539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9293fd4552504ce185e6815de0d9f76d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:29.704937 10331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9293fd4552504ce185e6815de0d9f76d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:29.711320 10129 tablet_service.cc:1467] Processing CreateTablet for tablet 9293fd4552504ce185e6815de0d9f76d (DEFAULT_TABLE table=test-table [id=92a263a5efc5428babd8fdb4d0d62755]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:32:29.711714 10678 tablet_bootstrap.cc:492] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: Bootstrap starting.
I20260809 06:32:29.711753 10129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9293fd4552504ce185e6815de0d9f76d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:29.713419 10678 tablet_bootstrap.cc:654] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:29.720556 10676 tablet_bootstrap.cc:492] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: Bootstrap starting.
I20260809 06:32:29.722285 10676 tablet_bootstrap.cc:654] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:29.724222 10678 tablet_bootstrap.cc:492] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: No bootstrap required, opened a new log
I20260809 06:32:29.724483 10678 ts_tablet_manager.cc:1397] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.008s
I20260809 06:32:29.725358 10678 raft_consensus.cc:348] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.725703 10678 raft_consensus.cc:374] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:29.725875 10678 raft_consensus.cc:729] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6208e680b1042c98274a25cde68081e, State: Initialized, Role: FOLLOWER
I20260809 06:32:29.726212 10678 consensus_queue.cc:260] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.727893 10678 ts_tablet_manager.cc:1428] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260809 06:32:29.729315 10681 tablet_bootstrap.cc:492] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: Bootstrap starting.
I20260809 06:32:29.731058 10681 tablet_bootstrap.cc:654] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:29.734015 10681 tablet_bootstrap.cc:492] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: No bootstrap required, opened a new log
I20260809 06:32:29.734254 10681 ts_tablet_manager.cc:1397] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260809 06:32:29.735059 10681 raft_consensus.cc:348] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.735330 10681 raft_consensus.cc:374] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:29.735416 10681 raft_consensus.cc:729] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3ce8feb4564684963b7ad1a0d024e8, State: Initialized, Role: FOLLOWER
I20260809 06:32:29.735677 10681 consensus_queue.cc:260] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.736605 10676 tablet_bootstrap.cc:492] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: No bootstrap required, opened a new log
I20260809 06:32:29.736783 10676 ts_tablet_manager.cc:1397] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s
I20260809 06:32:29.737543 10676 raft_consensus.cc:348] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.738758 10681 ts_tablet_manager.cc:1428] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260809 06:32:29.739053 10676 raft_consensus.cc:374] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:29.739195 10676 raft_consensus.cc:729] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a7db6cdae43b98cf081f6b90b8c39, State: Initialized, Role: FOLLOWER
I20260809 06:32:29.739755 10676 consensus_queue.cc:260] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:29.741917 10676 ts_tablet_manager.cc:1428] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260809 06:32:30.066696 10740 raft_consensus.cc:482] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:32:30.066926 10740 raft_consensus.cc:504] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:30.067641 10740 leader_election.cc:288] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515), e6208e680b1042c98274a25cde68081e (127.30.78.67:46331)
I20260809 06:32:30.068223 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293fd4552504ce185e6815de0d9f76d" candidate_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6208e680b1042c98274a25cde68081e" is_pre_election: true
I20260809 06:32:30.068209 10356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293fd4552504ce185e6815de0d9f76d" candidate_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" is_pre_election: true
I20260809 06:32:30.068457 10577 raft_consensus.cc:2454] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3ce8feb4564684963b7ad1a0d024e8 in term 0.
I20260809 06:32:30.068492 10356 raft_consensus.cc:2454] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb3ce8feb4564684963b7ad1a0d024e8 in term 0.
I20260809 06:32:30.068917 10059 leader_election.cc:302] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb3ce8feb4564684963b7ad1a0d024e8, e6208e680b1042c98274a25cde68081e; no voters:
I20260809 06:32:30.069226 10740 raft_consensus.cc:2781] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:32:30.069351 10740 raft_consensus.cc:482] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:32:30.069456 10740 raft_consensus.cc:3037] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:30.071569 10740 raft_consensus.cc:504] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:30.072098 10740 leader_election.cc:288] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [CANDIDATE]: Term 1 election: Requested vote from peers 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515), e6208e680b1042c98274a25cde68081e (127.30.78.67:46331)
I20260809 06:32:30.072527 10356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293fd4552504ce185e6815de0d9f76d" candidate_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39"
I20260809 06:32:30.072765 10356 raft_consensus.cc:3037] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:30.072736 10577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293fd4552504ce185e6815de0d9f76d" candidate_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6208e680b1042c98274a25cde68081e"
I20260809 06:32:30.072952 10577 raft_consensus.cc:3037] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:30.075683 10577 raft_consensus.cc:2454] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb3ce8feb4564684963b7ad1a0d024e8 in term 1.
I20260809 06:32:30.075683 10356 raft_consensus.cc:2454] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb3ce8feb4564684963b7ad1a0d024e8 in term 1.
I20260809 06:32:30.076086 10059 leader_election.cc:302] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb3ce8feb4564684963b7ad1a0d024e8, e6208e680b1042c98274a25cde68081e; no voters:
I20260809 06:32:30.076388 10740 raft_consensus.cc:2781] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:30.076530 10740 raft_consensus.cc:686] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 LEADER]: Becoming Leader. State: Replica: bb3ce8feb4564684963b7ad1a0d024e8, State: Running, Role: LEADER
I20260809 06:32:30.076850 10740 consensus_queue.cc:237] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } }
I20260809 06:32:30.079741 9921 catalog_manager.cc:5495] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65). New cstate: current_term: 1 leader_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb3ce8feb4564684963b7ad1a0d024e8" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 35159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 } health_report { overall_health: UNKNOWN } } }
I20260809 06:32:30.105897 10837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:30.101112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:34445 (local address 127.30.78.66:42515)
0809 06:32:30.101558 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:30.101565 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:30.101752 (+ 187us) server_negotiation.cc:407] Connection header received
0809 06:32:30.101936 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:30.101940 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:30.101999 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:30.102075 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:30.102464 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.103172 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.104519 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.104901 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.104997 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:30.105324 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:30.105412 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:30.105473 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:30.105560 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 06:32:30.105616 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":203,"threads_started":1}
I20260809 06:32:30.105912 10838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:30.101082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:42515 (local address 127.30.78.65:34445)
0809 06:32:30.101660 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:30.101676 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:30.101831 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:30.102091 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:30.102094 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:30.102103 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:32:30.102328 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:30.102337 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.103294 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.103298 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:30.104405 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:30.104418 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.105022 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.105027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:30.105135 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:30.105185 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:32:30.105481 (+ 296us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:32:30.105487 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:32:30.105538 (+ 51us) client_negotiation.cc:240] Negotiation successful
0809 06:32:30.105631 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":324,"threads_started":1}
I20260809 06:32:30.112845 10577 raft_consensus.cc:1261] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Refusing update from remote peer bb3ce8feb4564684963b7ad1a0d024e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:30.112843 10356 raft_consensus.cc:1261] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Refusing update from remote peer bb3ce8feb4564684963b7ad1a0d024e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:32:30.113348 10740 consensus_queue.cc:1035] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c2a7db6cdae43b98cf081f6b90b8c39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 42515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:30.113610 10813 consensus_queue.cc:1035] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6208e680b1042c98274a25cde68081e" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 46331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:32:30.117818 10771 mvcc.cc:205] Tried to move back new op lower bound from 7316509286858092544 to 7316509286717464576. Current Snapshot: MvccSnapshot[applied={T|T < 7316509286858092544}]
I20260809 06:32:30.136094 10818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:30.131372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:44387 (local address 127.30.78.65:35159)
0809 06:32:30.131516 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:30.131521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:30.131948 (+ 427us) server_negotiation.cc:407] Connection header received
0809 06:32:30.132056 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:30.132060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:30.132116 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:30.132181 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:32:30.132475 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.133150 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.134643 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.135159 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.135260 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:30.135609 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:32:30.135697 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:32:30.135755 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:30.135844 (+ 89us) server_negotiation.cc:299] Negotiation successful
0809 06:32:30.135902 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 06:32:30.136158 10844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:30.131320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:35159 (local address 127.30.78.66:44387)
0809 06:32:30.131850 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:30.131877 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:30.131978 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:30.132187 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:30.132189 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:30.132197 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0809 06:32:30.132387 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:30.132394 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.133257 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.133261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:30.134503 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:30.134518 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.135329 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.135334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:30.135459 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:30.135496 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0809 06:32:30.135764 (+ 268us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0809 06:32:30.135770 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:32:30.135823 (+ 53us) client_negotiation.cc:240] Negotiation successful
0809 06:32:30.135913 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":299,"threads_started":1}
I20260809 06:32:30.158641 9918 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:30.158843 9918 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:32:30.161581 9918 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ff927487201644ec92f92316a16d628c: Sending DeleteTablet for 3 replicas of tablet 9293fd4552504ce185e6815de0d9f76d
I20260809 06:32:30.162262 10129 tablet_service.cc:1514] Processing DeleteTablet for tablet 9293fd4552504ce185e6815de0d9f76d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:30 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:55114
I20260809 06:32:30.162387 10331 tablet_service.cc:1514] Processing DeleteTablet for tablet 9293fd4552504ce185e6815de0d9f76d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:30 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:47800
I20260809 06:32:30.162559 10784 tablet_replica.cc:330] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: stopping tablet replica
I20260809 06:32:30.162637 10785 tablet_replica.cc:330] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: stopping tablet replica
I20260809 06:32:30.162744 10784 raft_consensus.cc:2229] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:32:30.162803 10785 raft_consensus.cc:2229] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:30.162988 10785 raft_consensus.cc:2258] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:30.163025 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 10032
I20260809 06:32:30.163048 10784 raft_consensus.cc:2258] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:30.163933 10784 ts_tablet_manager.cc:1905] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:30.165665 10539 tablet_service.cc:1514] Processing DeleteTablet for tablet 9293fd4552504ce185e6815de0d9f76d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:32:30 UTC) from {username='oryx', principal='oryx/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:36008
I20260809 06:32:30.165972 10786 tablet_replica.cc:330] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: stopping tablet replica
I20260809 06:32:30.166139 10786 raft_consensus.cc:2229] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:32:30.166338 10786 raft_consensus.cc:2258] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:32:30.166544 10785 ts_tablet_manager.cc:1905] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:30.167384 10786 ts_tablet_manager.cc:1905] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:32:30.170264 10784 ts_tablet_manager.cc:1918] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:32:30.170387 10784 log.cc:1196] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/9293fd4552504ce185e6815de0d9f76d
I20260809 06:32:30.170766 10784 ts_tablet_manager.cc:1939] T 9293fd4552504ce185e6815de0d9f76d P bb3ce8feb4564684963b7ad1a0d024e8: Deleting consensus metadata
I20260809 06:32:30.171679 9904 catalog_manager.cc:4841] TS bb3ce8feb4564684963b7ad1a0d024e8 (127.30.78.65:35159): tablet 9293fd4552504ce185e6815de0d9f76d (table test-table [id=92a263a5efc5428babd8fdb4d0d62755]) successfully deleted
I20260809 06:32:30.173352 10786 ts_tablet_manager.cc:1918] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:32:30.173398 10785 ts_tablet_manager.cc:1918] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260809 06:32:30.173441 10786 log.cc:1196] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/9293fd4552504ce185e6815de0d9f76d
I20260809 06:32:30.173522 10785 log.cc:1196] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/9293fd4552504ce185e6815de0d9f76d
I20260809 06:32:30.173750 10786 ts_tablet_manager.cc:1939] T 9293fd4552504ce185e6815de0d9f76d P e6208e680b1042c98274a25cde68081e: Deleting consensus metadata
I20260809 06:32:30.174265 10785 ts_tablet_manager.cc:1939] T 9293fd4552504ce185e6815de0d9f76d P 0c2a7db6cdae43b98cf081f6b90b8c39: Deleting consensus metadata
I20260809 06:32:30.174640 9902 catalog_manager.cc:4841] TS e6208e680b1042c98274a25cde68081e (127.30.78.67:46331): tablet 9293fd4552504ce185e6815de0d9f76d (table test-table [id=92a263a5efc5428babd8fdb4d0d62755]) successfully deleted
I20260809 06:32:30.175215 9905 catalog_manager.cc:4841] TS 0c2a7db6cdae43b98cf081f6b90b8c39 (127.30.78.66:42515): tablet 9293fd4552504ce185e6815de0d9f76d (table test-table [id=92a263a5efc5428babd8fdb4d0d62755]) successfully deleted
Aug 09 06:32:30 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.65@KRBTEST.COM
I20260809 06:32:30.187718 10818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:30.171707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55126 (local address 127.30.78.65:35159)
0809 06:32:30.171877 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:30.171883 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:30.174892 (+ 3009us) server_negotiation.cc:407] Connection header received
0809 06:32:30.175050 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:30.175055 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:30.175171 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:30.175287 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:30.176526 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.177234 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.178479 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.178852 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.178951 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:30.182627 (+ 3676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:30.182639 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:30.182655 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:30.182686 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:30.185209 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:30.185822 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:30.185829 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:30.185831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:30.185965 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:30.186307 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:30.186311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:30.186313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:30.186648 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:30.186931 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:30.187211 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 06:32:30.187418 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:32:30.188295 10224 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:30.313905 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 10032
I20260809 06:32:30.344475 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 10235
Aug 09 06:32:30 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.66@KRBTEST.COM
I20260809 06:32:30.357699 10837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:30.345284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47818 (local address 127.30.78.66:42515)
0809 06:32:30.345439 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:30.345443 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:30.345460 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:32:30.345515 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:30.345519 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:30.345579 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:30.345660 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:30.346832 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.347519 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.348663 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.349056 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.349148 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:30.352876 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:30.352889 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:30.352907 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:30.352947 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:30.355626 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:30.356139 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:30.356146 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:30.356148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:30.356271 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:30.356526 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:30.356529 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:30.356531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:30.356879 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:30.357120 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:30.357293 (+ 173us) server_negotiation.cc:299] Negotiation successful
0809 06:32:30.357477 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 06:32:30.358387 10430 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:30.503566 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 10235
I20260809 06:32:30.532318 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 10443
Aug 09 06:32:30 dist-test-slave-cvwc krb5kdc[9863](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.78.67@KRBTEST.COM
I20260809 06:32:30.547114 10852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:30.533057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36032 (local address 127.30.78.67:46331)
0809 06:32:30.533554 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:30.533558 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:30.533572 (+ 14us) server_negotiation.cc:407] Connection header received
0809 06:32:30.533625 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:30.533629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:30.533692 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:30.533818 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:30.535091 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.535785 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.536995 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:30.537393 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:30.537511 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:30.541812 (+ 4301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:30.541828 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:30.541845 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:30.541885 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:30.544520 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:30.545104 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:30.545112 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:30.545114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:30.545249 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:30.545604 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:30.545608 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:30.545610 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:30.546019 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:30.546288 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:30.546565 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 06:32:30.546782 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":245,"threads_started":1}
I20260809 06:32:30.547803 10634 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:30.669040 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 10443
I20260809 06:32:30.697508 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 9881
I20260809 06:32:30.698696 9982 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:30.812067 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 9881
2026-08-09T06:32:30Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7285 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:32:30 dist-test-slave-cvwc krb5kdc[10857](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:32:30 dist-test-slave-cvwc krb5kdc[10857](info): set up 2 sockets
Aug 09 06:32:30 dist-test-slave-cvwc krb5kdc[10857](info): commencing operation
krb5kdc: starting...
W20260809 06:32:32.016856 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:32:32 dist-test-slave-cvwc krb5kdc[10857](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:32:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:32:32.226752 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:40753
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:39773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:40753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:32.547015 10879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:32.547277 10879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:32.547362 10879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:32.554435 10879 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:32.554544 10879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:32.554605 10879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:32.554667 10879 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:32.554729 10879 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:32.564332 10879 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:40753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:40753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:32.565527 10879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:32.566820 10879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:32.578116 10886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:32.578071 10887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:32.578043 10889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:32.578630 10879 server_base.cc:1034] running on GCE node
I20260809 06:32:32.579386 10879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:32.580677 10879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:32.581852 10879 hybrid_clock.cc:648] HybridClock initialized: now 1786257152581796 us; error 44 us; skew 500 ppm
I20260809 06:32:32.582161 10879 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-09T06:32:32Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1831 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:32:32 dist-test-slave-cvwc krb5kdc[10900](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:32:32 dist-test-slave-cvwc krb5kdc[10900](info): set up 2 sockets
Aug 09 06:32:32 dist-test-slave-cvwc krb5kdc[10900](info): commencing operation
krb5kdc: starting...
W20260809 06:32:33.841863 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.001s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:32:33 dist-test-slave-cvwc krb5kdc[10900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:32:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:32:34.054740 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:38249
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:38249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:34.369429 10923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:34.369699 10923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:34.369838 10923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:34.376785 10923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:34.376883 10923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:34.376937 10923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:34.376992 10923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:34.377035 10923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:34.386461 10923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:38249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:38249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:34.387635 10923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:34.388859 10923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:34.399677 10931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:34.399662 10930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:34.399649 10935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:34.400754 10923 server_base.cc:1034] running on GCE node
I20260809 06:32:34.401408 10923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:34.402662 10923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:34.403868 10923 hybrid_clock.cc:648] HybridClock initialized: now 1786257154403811 us; error 48 us; skew 500 ppm
I20260809 06:32:34.404161 10923 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:34 dist-test-slave-cvwc krb5kdc[10900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257154, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:34.409812 10923 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:32:34.411181 10923 webserver.cc:460] Webserver started at http://127.30.78.126:40901/ using document root <none> and password file <none>
I20260809 06:32:34.411800 10923 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:34.411908 10923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:34.412199 10923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:34.415041 10923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "ff4fd95cf14c483c86485227c9c356f6"
format_stamp: "Formatted at 2026-08-09 06:32:34 on dist-test-slave-cvwc"
server_key: "659ec913116c16f56438a6b206a0dda5"
server_key_iv: "9051632c5fc63d042ac16369695186ab"
server_key_version: "encryptionkey@0"
I20260809 06:32:34.415750 10923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "ff4fd95cf14c483c86485227c9c356f6"
format_stamp: "Formatted at 2026-08-09 06:32:34 on dist-test-slave-cvwc"
server_key: "659ec913116c16f56438a6b206a0dda5"
server_key_iv: "9051632c5fc63d042ac16369695186ab"
server_key_version: "encryptionkey@0"
I20260809 06:32:34.420504 10923 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:32:34.423702 10942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:34.424888 10923 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:34.425040 10923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "ff4fd95cf14c483c86485227c9c356f6"
format_stamp: "Formatted at 2026-08-09 06:32:34 on dist-test-slave-cvwc"
server_key: "659ec913116c16f56438a6b206a0dda5"
server_key_iv: "9051632c5fc63d042ac16369695186ab"
server_key_version: "encryptionkey@0"
I20260809 06:32:34.425215 10923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:34.449236 10923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:34.453202 10923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:34.453466 10923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:34.470312 10923 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:38249
I20260809 06:32:34.470346 11028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:38249 every 8 connection(s)
I20260809 06:32:34.471575 10923 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:34.473217 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 10923
I20260809 06:32:34.473460 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:34.474288 31033 external_mini_cluster.cc:1428] Setting key 4fb4e3393b463cdf4e128c982c8af78f
I20260809 06:32:34.476016 11029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:32:34 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:34.489568 11029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: Bootstrap starting.
I20260809 06:32:34.492867 11029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:34.493863 11029 log.cc:824] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:34.496582 11029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: No bootstrap required, opened a new log
I20260809 06:32:34.496680 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:34.476328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33884 (local address 127.30.78.126:38249)
0809 06:32:34.477066 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:34.477077 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:34.477116 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:32:34.478760 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:34.478782 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:34.479145 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:34.479470 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:34.481274 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:34.482623 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:34.484399 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:34.485050 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:34.485184 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:34.489926 (+ 4742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:34.489934 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:34.489948 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:34.489987 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:34.492837 (+ 2850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:34.493493 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:34.493500 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:34.493506 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:34.493679 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:34.494080 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:34.494086 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:34.494089 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:34.494626 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:34.494934 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:34.495372 (+ 438us) server_negotiation.cc:299] Negotiation successful
0809 06:32:34.495760 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":338,"threads_started":1}
I20260809 06:32:34.504575 11029 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } }
I20260809 06:32:34.504920 11029 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:34.505018 11029 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4fd95cf14c483c86485227c9c356f6, State: Initialized, Role: FOLLOWER
I20260809 06:32:34.505594 11029 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } }
I20260809 06:32:34.505877 11029 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:34.506007 11029 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:34.506157 11029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:34.508116 11029 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } }
I20260809 06:32:34.508551 11029 leader_election.cc:302] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff4fd95cf14c483c86485227c9c356f6; no voters:
I20260809 06:32:34.509114 11029 leader_election.cc:288] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:34.509250 11037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:34.509876 11037 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 1 LEADER]: Becoming Leader. State: Replica: ff4fd95cf14c483c86485227c9c356f6, State: Running, Role: LEADER
I20260809 06:32:34.510492 11037 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } }
I20260809 06:32:34.511134 11029 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:34.512995 11039 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff4fd95cf14c483c86485227c9c356f6. Latest consensus state: current_term: 1 leader_uuid: "ff4fd95cf14c483c86485227c9c356f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } } }
I20260809 06:32:34.513584 11039 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:34.517896 11038 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff4fd95cf14c483c86485227c9c356f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } } }
I20260809 06:32:34.518203 11038 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:34.519192 11047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:34.523128 11047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:34.531148 11047 catalog_manager.cc:1347] Generated new cluster ID: 55fb32ed79e34ec98dd20b51e3e88e92
I20260809 06:32:34.531258 11047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:34.552786 11047 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:34.554697 11047 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:34.564940 11047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: Generated new TSK 0
I20260809 06:32:34.565791 11047 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:32:34.636613 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:38249
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:34.990582 11064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:34.990846 11064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:34.990944 11064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:34.998468 11064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:34.998562 11064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:34.998677 11064 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:35.007754 11064 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:38249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:35.008875 11064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:35.010093 11064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:35.022531 11076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:35.022477 11072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:35.022809 11074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:35.023499 11064 server_base.cc:1034] running on GCE node
I20260809 06:32:35.024067 11064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:35.024950 11064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:35.026139 11064 hybrid_clock.cc:648] HybridClock initialized: now 1786257155026096 us; error 31 us; skew 500 ppm
I20260809 06:32:35.026414 11064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:35 dist-test-slave-cvwc krb5kdc[10900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257155, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:35.029624 11064 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:32:35.031494 11064 webserver.cc:460] Webserver started at http://127.30.78.65:34317/ using document root <none> and password file <none>
I20260809 06:32:35.032341 11064 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:35.032483 11064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:35.032821 11064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:35.036309 11064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "460941e0bdac4b29a69687591f93e58b"
format_stamp: "Formatted at 2026-08-09 06:32:35 on dist-test-slave-cvwc"
server_key: "cf6e2c0edc1097f950f97b738dc367b8"
server_key_iv: "9ec784f8a895dcdaa67b978224644ee8"
server_key_version: "encryptionkey@0"
I20260809 06:32:35.037056 11064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "460941e0bdac4b29a69687591f93e58b"
format_stamp: "Formatted at 2026-08-09 06:32:35 on dist-test-slave-cvwc"
server_key: "cf6e2c0edc1097f950f97b738dc367b8"
server_key_iv: "9ec784f8a895dcdaa67b978224644ee8"
server_key_version: "encryptionkey@0"
I20260809 06:32:35.042956 11064 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260809 06:32:35.047118 11087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:35.048599 11064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:32:35.048763 11064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "460941e0bdac4b29a69687591f93e58b"
format_stamp: "Formatted at 2026-08-09 06:32:35 on dist-test-slave-cvwc"
server_key: "cf6e2c0edc1097f950f97b738dc367b8"
server_key_iv: "9ec784f8a895dcdaa67b978224644ee8"
server_key_version: "encryptionkey@0"
I20260809 06:32:35.048951 11064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:35.074802 11064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:35.078493 11064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:35.078749 11064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:35.079631 11064 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:35.080916 11064 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:35.080992 11064 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:35.081107 11064 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:35.081161 11064 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:35.110443 11064 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:41845
I20260809 06:32:35.110502 11253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:41845 every 8 connection(s)
I20260809 06:32:35.111701 11064 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:35.114025 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 11064
I20260809 06:32:35.114231 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:32:35.115031 31033 external_mini_cluster.cc:1428] Setting key e5440624f63abdd37ad35159a7e94d92
Aug 09 06:32:35 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257155, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:35.131013 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:35.114200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:55451 (local address 127.30.78.126:38249)
0809 06:32:35.114641 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:35.114645 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:35.115891 (+ 1246us) server_negotiation.cc:407] Connection header received
0809 06:32:35.117830 (+ 1939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:35.117836 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:35.117927 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:35.118023 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:35.119456 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:35.120169 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:35.121656 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:35.122105 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:35.122221 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:35.125395 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:35.125400 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:35.125403 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:35.125435 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:35.127978 (+ 2543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:35.128832 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:35.128836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:35.128839 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:35.128959 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:35.129426 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:35.129430 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:35.129432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:35.129684 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:35.129835 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:35.130606 (+ 771us) server_negotiation.cc:299] Negotiation successful
0809 06:32:35.130765 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":224,"threads_started":1}
I20260809 06:32:35.132200 11259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:35.114929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:55451)
0809 06:32:35.115695 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:35.115748 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:35.117565 (+ 1817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:35.118259 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:35.118267 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:35.118771 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:35.119293 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:35.119309 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:35.120312 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:35.120316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:35.121516 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:35.121532 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:35.122320 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:35.122327 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:35.122548 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:35.123145 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:35.123165 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:35.125193 (+ 2028us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:35.128113 (+ 2920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:35.128120 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:35.128133 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:35.128726 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:35.129107 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:35.129111 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:35.129114 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:35.129326 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:35.129817 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:35.129825 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:35.130232 (+ 407us) client_negotiation.cc:769] Sending connection context
0809 06:32:35.130523 (+ 291us) client_negotiation.cc:240] Negotiation successful
0809 06:32:35.130966 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":336,"threads_started":1}
I20260809 06:32:35.133620 11255 heartbeater.cc:347] Connected to a master server at 127.30.78.126:38249
I20260809 06:32:35.133908 11255 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:35.134608 11255 heartbeater.cc:511] Master 127.30.78.126:38249 requested a full tablet report, sending...
I20260809 06:32:35.136816 10972 ts_manager.cc:194] Registered new tserver with Master: 460941e0bdac4b29a69687591f93e58b (127.30.78.65:41845)
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
I20260809 06:32:35.138842 10972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:55451
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:32:35.164932 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:38249
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:35.479821 11266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:35.480199 11266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:35.480383 11266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:35.491969 11266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:35.492103 11266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:35.492307 11266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:35.502249 11266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:38249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:35.503391 11266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:35.504640 11266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:35.517345 11275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:35.517318 11278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:35.517386 11281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:35.518318 11266 server_base.cc:1034] running on GCE node
I20260809 06:32:35.518975 11266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:35.520998 11266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:35.522218 11266 hybrid_clock.cc:648] HybridClock initialized: now 1786257155522178 us; error 35 us; skew 500 ppm
I20260809 06:32:35.522475 11266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:35 dist-test-slave-cvwc krb5kdc[10900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257155, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:35.525318 11266 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:32:35.526662 11266 webserver.cc:460] Webserver started at http://127.30.78.66:45321/ using document root <none> and password file <none>
I20260809 06:32:35.527266 11266 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:35.527362 11266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:35.527608 11266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:35.530412 11266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "9f336457f59b47cf995ffdb1e546dc4e"
format_stamp: "Formatted at 2026-08-09 06:32:35 on dist-test-slave-cvwc"
server_key: "08b067a9a16c23c7f7358a7259d50cc3"
server_key_iv: "6bc78a5df89b7344a3018be35961a38d"
server_key_version: "encryptionkey@0"
I20260809 06:32:35.531119 11266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "9f336457f59b47cf995ffdb1e546dc4e"
format_stamp: "Formatted at 2026-08-09 06:32:35 on dist-test-slave-cvwc"
server_key: "08b067a9a16c23c7f7358a7259d50cc3"
server_key_iv: "6bc78a5df89b7344a3018be35961a38d"
server_key_version: "encryptionkey@0"
I20260809 06:32:35.535754 11266 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:32:35.538858 11291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:35.540022 11266 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:32:35.540159 11266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "9f336457f59b47cf995ffdb1e546dc4e"
format_stamp: "Formatted at 2026-08-09 06:32:35 on dist-test-slave-cvwc"
server_key: "08b067a9a16c23c7f7358a7259d50cc3"
server_key_iv: "6bc78a5df89b7344a3018be35961a38d"
server_key_version: "encryptionkey@0"
I20260809 06:32:35.540344 11266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:35.561618 11266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:35.565200 11266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:35.565459 11266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:35.566390 11266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:35.567598 11266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:35.567673 11266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:35.567785 11266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:35.567836 11266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:35.597795 11266 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:43007
I20260809 06:32:35.597858 11457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:43007 every 8 connection(s)
I20260809 06:32:35.599049 11266 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:35.602242 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 11266
I20260809 06:32:35.602427 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:32:35.602977 31033 external_mini_cluster.cc:1428] Setting key 229a4d838b4609eddd1fa05873ff26e9
Aug 09 06:32:35 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257155, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:35.619035 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:35.601420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:43005 (local address 127.30.78.126:38249)
0809 06:32:35.601591 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:35.601596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:35.602897 (+ 1301us) server_negotiation.cc:407] Connection header received
0809 06:32:35.605105 (+ 2208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:35.605111 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:35.605192 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:35.605282 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:35.606743 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:35.607430 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:35.608913 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:35.609352 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:35.609471 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:35.613026 (+ 3555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:35.613031 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:35.613034 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:35.613065 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:35.616144 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:35.616820 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:35.616826 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:35.616829 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:35.616978 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:35.617344 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:35.617349 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:35.617351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:35.617663 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:35.617822 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:35.618493 (+ 671us) server_negotiation.cc:299] Negotiation successful
0809 06:32:35.618707 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:32:35.619697 11461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:35.601942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:43005)
0809 06:32:35.602736 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:35.602776 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:35.604827 (+ 2051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:35.605514 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:35.605522 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:35.606051 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:35.606580 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:35.606597 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:35.607583 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:35.607587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:35.608779 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:35.608791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:35.609567 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:35.609574 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:35.609826 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:35.610418 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:35.610438 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:35.612825 (+ 2387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:35.616265 (+ 3440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:35.616271 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:35.616282 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:35.616687 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:35.617071 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:35.617074 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:35.617077 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:35.617240 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:35.617822 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:35.617828 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:35.618119 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 06:32:35.618323 (+ 204us) client_negotiation.cc:240] Negotiation successful
0809 06:32:35.618690 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":328,"threads_started":1}
I20260809 06:32:35.620966 11458 heartbeater.cc:347] Connected to a master server at 127.30.78.126:38249
I20260809 06:32:35.621230 11458 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:35.621919 11458 heartbeater.cc:511] Master 127.30.78.126:38249 requested a full tablet report, sending...
I20260809 06:32:35.623257 10972 ts_manager.cc:194] Registered new tserver with Master: 9f336457f59b47cf995ffdb1e546dc4e (127.30.78.66:43007)
I20260809 06:32:35.624039 10972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:43005
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:32:35.653169 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:38249
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:35.969978 11464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:35.970232 11464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:35.970330 11464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:35.977227 11464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:35.977320 11464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:35.977432 11464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:35.986585 11464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:38249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:35.987721 11464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:35.988937 11464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:36.000932 11472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:36.001019 11476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:36.001050 11474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:36.002238 11464 server_base.cc:1034] running on GCE node
I20260809 06:32:36.002789 11464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:36.003631 11464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:36.004819 11464 hybrid_clock.cc:648] HybridClock initialized: now 1786257156004773 us; error 42 us; skew 500 ppm
I20260809 06:32:36.005101 11464 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:36 dist-test-slave-cvwc krb5kdc[10900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257156, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:36.007998 11464 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:32:36.009326 11464 webserver.cc:460] Webserver started at http://127.30.78.67:44623/ using document root <none> and password file <none>
I20260809 06:32:36.010056 11464 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:36.010172 11464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:36.010466 11464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:36.013271 11464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "945a1c2ddeee4197a0c5675f1bec580e"
format_stamp: "Formatted at 2026-08-09 06:32:36 on dist-test-slave-cvwc"
server_key: "703bc0bb44a538474b4e12a002ff0ecc"
server_key_iv: "f5385f9de24e48104083e8ec266010af"
server_key_version: "encryptionkey@0"
I20260809 06:32:36.014130 11464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "945a1c2ddeee4197a0c5675f1bec580e"
format_stamp: "Formatted at 2026-08-09 06:32:36 on dist-test-slave-cvwc"
server_key: "703bc0bb44a538474b4e12a002ff0ecc"
server_key_iv: "f5385f9de24e48104083e8ec266010af"
server_key_version: "encryptionkey@0"
I20260809 06:32:36.018971 11464 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:32:36.022132 11487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:36.023298 11464 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 06:32:36.023452 11464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "945a1c2ddeee4197a0c5675f1bec580e"
format_stamp: "Formatted at 2026-08-09 06:32:36 on dist-test-slave-cvwc"
server_key: "703bc0bb44a538474b4e12a002ff0ecc"
server_key_iv: "f5385f9de24e48104083e8ec266010af"
server_key_version: "encryptionkey@0"
I20260809 06:32:36.023633 11464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:36.035082 11464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:36.038493 11464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:36.038735 11464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:36.039570 11464 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:36.040773 11464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:36.040848 11464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:36.040956 11464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:36.041013 11464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:36.070544 11464 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:42633
I20260809 06:32:36.070574 11646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:42633 every 8 connection(s)
I20260809 06:32:36.071743 11464 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:36.080317 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 11464
I20260809 06:32:36.080475 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:32:36.080906 31033 external_mini_cluster.cc:1428] Setting key 5a11ea916e8f126d6164388a28d524e6
Aug 09 06:32:36 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257156, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:32:36.090445 11258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:36.074146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:51995 (local address 127.30.78.126:38249)
0809 06:32:36.074320 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:36.074325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:36.075399 (+ 1074us) server_negotiation.cc:407] Connection header received
0809 06:32:36.077155 (+ 1756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:36.077161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:36.077263 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:36.077353 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:36.078840 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.079578 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.081153 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.081660 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.081810 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:36.085327 (+ 3517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:36.085332 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:36.085335 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:36.085374 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:36.087649 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:36.088301 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:36.088305 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:36.088307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:36.088438 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:36.088832 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:36.088836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:36.088838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:36.089091 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:36.089221 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:36.089890 (+ 669us) server_negotiation.cc:299] Negotiation successful
0809 06:32:36.090107 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:32:36.091250 11649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:36.074556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:51995)
0809 06:32:36.075232 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:36.075272 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:36.076904 (+ 1632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:36.077584 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:36.077591 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:36.078130 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:36.078681 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:36.078699 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.079717 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.079721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:36.081016 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:36.081029 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.081903 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.081911 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:36.082137 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:36.082777 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:36.082799 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:36.085141 (+ 2342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:36.087781 (+ 2640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:36.087789 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:36.087804 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:36.088190 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:36.088541 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:32:36.088546 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:32:36.088550 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:32:36.088727 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:32:36.089214 (+ 487us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:36.089222 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:36.089514 (+ 292us) client_negotiation.cc:769] Sending connection context
0809 06:32:36.089754 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 06:32:36.090234 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":267,"threads_started":1}
I20260809 06:32:36.092444 11647 heartbeater.cc:347] Connected to a master server at 127.30.78.126:38249
I20260809 06:32:36.092716 11647 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:36.093384 11647 heartbeater.cc:511] Master 127.30.78.126:38249 requested a full tablet report, sending...
I20260809 06:32:36.094800 10972 ts_manager.cc:194] Registered new tserver with Master: 945a1c2ddeee4197a0c5675f1bec580e (127.30.78.67:42633)
I20260809 06:32:36.095656 10972 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:51995
I20260809 06:32:36.096086 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.65@KRBTEST.COM" created.
I20260809 06:32:36.141568 11255 heartbeater.cc:503] Master 127.30.78.126:38249 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab.
Entry for principal oryx/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab.
WARNING: no policy specified for oryx/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab.
Entry for principal oryx/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab.
WARNING: no policy specified for oryx/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab.
Entry for principal oryx/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab.
I20260809 06:32:36.221246 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 11064
Aug 09 06:32:36 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:32:36.236485 11665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:36.222287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.30.78.65:41845)
0809 06:32:36.223055 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:36.223062 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:36.223089 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:32:36.223156 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:36.223163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:36.223362 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:36.223500 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:36.224701 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.225678 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.226986 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.227543 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.227653 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:36.231531 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:36.231542 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:36.231556 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:36.231587 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:36.234338 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:36.234903 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:36.234909 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:36.234912 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:36.235030 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:36.235294 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:36.235297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:36.235299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:36.235614 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:36.235833 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:36.236004 (+ 171us) server_negotiation.cc:299] Negotiation successful
0809 06:32:36.236195 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":463,"threads_started":1}
I20260809 06:32:36.237673 11247 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:36.319345 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 11064
I20260809 06:32:36.340633 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 11266
Aug 09 06:32:36 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:32:36.355700 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:36.341405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54130 (local address 127.30.78.66:43007)
0809 06:32:36.341927 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:36.341934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:36.341958 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:32:36.342019 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:36.342025 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:36.342224 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:36.342377 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:36.343606 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.344613 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.345929 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.346466 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.346581 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:36.350464 (+ 3883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:36.350475 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:36.350487 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:36.350518 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:36.353024 (+ 2506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:36.353609 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:36.353616 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:36.353619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:36.353861 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:36.354201 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:36.354206 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:36.354210 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:36.354544 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:36.354827 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:36.355115 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 06:32:36.355362 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":240,"threads_started":1}
I20260809 06:32:36.356877 11450 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:36.436239 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 11266
I20260809 06:32:36.458536 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 11464
Aug 09 06:32:36 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:32:36.474033 11670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:36.459557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59718 (local address 127.30.78.67:42633)
0809 06:32:36.460184 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:36.460192 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:36.460220 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:32:36.460284 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:36.460290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:36.460490 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:36.460618 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:36.461891 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.462888 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.464058 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:36.464585 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:36.464675 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:36.468684 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:36.468695 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:36.468710 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:36.468742 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:36.471466 (+ 2724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:36.472171 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:36.472177 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:36.472179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:36.472301 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:36.472621 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:36.472624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:36.472626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:36.472950 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:36.473188 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:36.473457 (+ 269us) server_negotiation.cc:299] Negotiation successful
0809 06:32:36.473647 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":483,"thread_start_us":315,"threads_started":1}
I20260809 06:32:36.475334 11641 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:36.555629 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 11464
I20260809 06:32:36.577272 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 10923
I20260809 06:32:36.578523 11020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:36.679049 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 10923
I20260809 06:32:36.699926 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:38249
--webserver_interface=127.30.78.126
--webserver_port=40901
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:38249
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:32:37.014716 11673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:37.014979 11673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:37.015105 11673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:37.021943 11673 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:37.022039 11673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:37.022114 11673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:37.022186 11673 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:37.022244 11673 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:37.031548 11673 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:38249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:38249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=40901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:37.032692 11673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:37.033948 11673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:37.044704 11681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:37.044754 11684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:37.044780 11679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:37.045528 11673 server_base.cc:1034] running on GCE node
I20260809 06:32:37.046286 11673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:37.047545 11673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:37.048738 11673 hybrid_clock.cc:648] HybridClock initialized: now 1786257157048697 us; error 29 us; skew 500 ppm
I20260809 06:32:37.049036 11673 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:37 dist-test-slave-cvwc krb5kdc[10900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257157, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:37.051832 11673 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:32:37.053205 11673 webserver.cc:460] Webserver started at http://127.30.78.126:40901/ using document root <none> and password file <none>
I20260809 06:32:37.053879 11673 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:37.054019 11673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:37.059023 11673 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260809 06:32:37.061570 11693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:37.062788 11673 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 06:32:37.062952 11673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "ff4fd95cf14c483c86485227c9c356f6"
format_stamp: "Formatted at 2026-08-09 06:32:34 on dist-test-slave-cvwc"
server_key: "659ec913116c16f56438a6b206a0dda5"
server_key_iv: "9051632c5fc63d042ac16369695186ab"
server_key_version: "encryptionkey@0"
I20260809 06:32:37.063865 11673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:37.078859 11673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:37.082350 11673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:37.082578 11673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:37.099180 11673 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:38249
I20260809 06:32:37.099190 11766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:38249 every 8 connection(s)
I20260809 06:32:37.100524 11673 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:37.106894 11767 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:32:37.109896 11767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: Bootstrap starting.
I20260809 06:32:37.110667 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 11673
I20260809 06:32:37.111626 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:41845
--local_ip_for_outbound_sockets=127.30.78.65
--tserver_master_addrs=127.30.78.126:38249
--webserver_port=34317
--webserver_interface=127.30.78.65
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.78.65
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:32:37.130790 11767 log.cc:824] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:37.139142 11767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:32:37.139609 11767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: Bootstrap complete.
I20260809 06:32:37.148006 11767 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } }
I20260809 06:32:37.148777 11767 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4fd95cf14c483c86485227c9c356f6, State: Initialized, Role: FOLLOWER
I20260809 06:32:37.149377 11767 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } }
I20260809 06:32:37.149590 11767 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:37.149698 11767 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:37.149890 11767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:32:37.153414 11767 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } }
I20260809 06:32:37.153889 11767 leader_election.cc:302] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff4fd95cf14c483c86485227c9c356f6; no voters:
I20260809 06:32:37.154455 11767 leader_election.cc:288] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 06:32:37.154582 11775 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 06:32:37.155671 11775 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [term 2 LEADER]: Becoming Leader. State: Replica: ff4fd95cf14c483c86485227c9c356f6, State: Running, Role: LEADER
I20260809 06:32:37.156267 11775 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } }
I20260809 06:32:37.156488 11767 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:37.158713 11780 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ff4fd95cf14c483c86485227c9c356f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } } }
I20260809 06:32:37.159072 11780 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:37.159575 11782 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff4fd95cf14c483c86485227c9c356f6. Latest consensus state: current_term: 2 leader_uuid: "ff4fd95cf14c483c86485227c9c356f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4fd95cf14c483c86485227c9c356f6" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 38249 } } }
I20260809 06:32:37.159874 11782 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:37.162933 11789 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:37.168983 11789 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:37.170356 11789 catalog_manager.cc:1259] Loaded cluster ID: 55fb32ed79e34ec98dd20b51e3e88e92
I20260809 06:32:37.170506 11789 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:37.174903 11789 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:37.176240 11789 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ff4fd95cf14c483c86485227c9c356f6: Loaded TSK: 0
I20260809 06:32:37.177655 11789 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 06:32:37.437582 11772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:37.437891 11772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:37.438032 11772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:37.444919 11772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:37.445032 11772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:37.445179 11772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:37.454496 11772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.65.keytab
--principal=oryx/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:41845
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=34317
--tserver_master_addrs=127.30.78.126:38249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:37.455691 11772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:37.456985 11772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:37.471403 11810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:37.471392 11812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:37.472422 11772 server_base.cc:1034] running on GCE node
W20260809 06:32:37.473922 11814 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:37.474701 11772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:37.475883 11772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:37.477133 11772 hybrid_clock.cc:648] HybridClock initialized: now 1786257157477064 us; error 51 us; skew 500 ppm
I20260809 06:32:37.477519 11772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:37 dist-test-slave-cvwc krb5kdc[10900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257157, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:37.481417 11772 init.cc:377] Logged in from keytab as oryx/127.30.78.65@KRBTEST.COM (short username oryx)
I20260809 06:32:37.483253 11772 webserver.cc:460] Webserver started at http://127.30.78.65:34317/ using document root <none> and password file <none>
I20260809 06:32:37.484109 11772 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:37.484272 11772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:37.491451 11772 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260809 06:32:37.494836 11821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:37.496428 11772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:32:37.496603 11772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "460941e0bdac4b29a69687591f93e58b"
format_stamp: "Formatted at 2026-08-09 06:32:35 on dist-test-slave-cvwc"
server_key: "cf6e2c0edc1097f950f97b738dc367b8"
server_key_iv: "9ec784f8a895dcdaa67b978224644ee8"
server_key_version: "encryptionkey@0"
I20260809 06:32:37.497956 11772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:37.523588 11772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:37.527614 11772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:37.527889 11772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:37.528992 11772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:37.530561 11772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:37.530689 11772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:37.530807 11772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:37.530885 11772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:37.561450 11772 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:41845
I20260809 06:32:37.561527 11991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:41845 every 8 connection(s)
I20260809 06:32:37.562956 11772 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:37.567277 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 11772
I20260809 06:32:37.567934 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:43007
--local_ip_for_outbound_sockets=127.30.78.66
--tserver_master_addrs=127.30.78.126:38249
--webserver_port=45321
--webserver_interface=127.30.78.66
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.78.66
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:32:37 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:37 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 06:32:37.883227 11999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:37.883479 11999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:37.883595 11999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:37.890652 11999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:37.890760 11999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:37.890910 11999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:37.900158 11999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.66.keytab
--principal=oryx/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:43007
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=45321
--tserver_master_addrs=127.30.78.126:38249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:37.901376 11999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:37.902675 11999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:37.917577 12009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:37.917783 12014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:37.918068 12008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:37.918514 11999 server_base.cc:1034] running on GCE node
I20260809 06:32:37.919303 11999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:37.920467 11999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:37.921706 11999 hybrid_clock.cc:648] HybridClock initialized: now 1786257157921644 us; error 44 us; skew 500 ppm
I20260809 06:32:37.922107 11999 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:37 dist-test-slave-cvwc krb5kdc[10900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257157, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:37.926259 11999 init.cc:377] Logged in from keytab as oryx/127.30.78.66@KRBTEST.COM (short username oryx)
I20260809 06:32:37.927997 11999 webserver.cc:460] Webserver started at http://127.30.78.66:45321/ using document root <none> and password file <none>
I20260809 06:32:37.928902 11999 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:37.929088 11999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:37.936378 11999 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:32:37.939805 12026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:37.941455 11999 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:32:37.941641 11999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "9f336457f59b47cf995ffdb1e546dc4e"
format_stamp: "Formatted at 2026-08-09 06:32:35 on dist-test-slave-cvwc"
server_key: "08b067a9a16c23c7f7358a7259d50cc3"
server_key_iv: "6bc78a5df89b7344a3018be35961a38d"
server_key_version: "encryptionkey@0"
I20260809 06:32:37.943096 11999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:37.981401 11999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:37.987243 11999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:37.987573 11999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:37.988863 11999 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:37.990756 11999 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:37.990880 11999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:37.990995 11999 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:37.991075 11999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:38.023155 11999 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:43007
I20260809 06:32:38.023188 12204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:43007 every 8 connection(s)
I20260809 06:32:38.025146 11999 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:38.031512 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 11999
I20260809 06:32:38.032301 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:42633
--local_ip_for_outbound_sockets=127.30.78.67
--tserver_master_addrs=127.30.78.126:38249
--webserver_port=44623
--webserver_interface=127.30.78.67
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.78.67
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:32:38 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:38 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 06:32:38.604581 12210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:38.605024 12210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:38.605211 12210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:38.613310 12210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:38.613421 12210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:38.613574 12210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:38.623835 12210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/krb5kdc/oryx_127.30.78.67.keytab
--principal=oryx/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:42633
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=44623
--tserver_master_addrs=127.30.78.126:38249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:38.625239 12210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:38.626694 12210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:38.643011 12222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:38.646874 12223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:38.646893 12225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:38.648329 12210 server_base.cc:1034] running on GCE node
I20260809 06:32:38.649011 12210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:38.650099 12210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:38.651412 12210 hybrid_clock.cc:648] HybridClock initialized: now 1786257158651353 us; error 46 us; skew 500 ppm
I20260809 06:32:38.651729 12210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:32:38 dist-test-slave-cvwc krb5kdc[10900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257158, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:32:38.654978 12210 init.cc:377] Logged in from keytab as oryx/127.30.78.67@KRBTEST.COM (short username oryx)
I20260809 06:32:38.662055 12210 webserver.cc:460] Webserver started at http://127.30.78.67:44623/ using document root <none> and password file <none>
I20260809 06:32:38.662981 12210 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:38.663192 12210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:38.670487 12210 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.001s
I20260809 06:32:38.683220 12235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:38.684906 12210 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.001s sys 0.011s
I20260809 06:32:38.685150 12210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "945a1c2ddeee4197a0c5675f1bec580e"
format_stamp: "Formatted at 2026-08-09 06:32:36 on dist-test-slave-cvwc"
server_key: "703bc0bb44a538474b4e12a002ff0ecc"
server_key_iv: "f5385f9de24e48104083e8ec266010af"
server_key_version: "encryptionkey@0"
I20260809 06:32:38.686307 12210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:38.720012 12210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:38.725268 12210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:38.725642 12210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:38.732992 12210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:38.743191 12210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:38.743289 12210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:38.743399 12210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:38.743471 12210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
W20260809 06:32:38.782018 11995 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.206s user 0.005s sys 0.008s
I20260809 06:32:38.783916 11995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:37.565825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:40077)
0809 06:32:37.566614 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:37.566656 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:37.568501 (+ 1845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:37.569924 (+ 1423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:37.569935 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:37.570494 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:37.571012 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:37.571029 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:37.572572 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:37.572576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:37.573803 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:37.573817 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:37.574821 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:37.574829 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:37.575092 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:37.575720 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:37.575756 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:38.782769 (+1207013us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":312,"threads_started":1}
W20260809 06:32:38.783970 11994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:37.565779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:40077 (local address 127.30.78.126:38249)
0809 06:32:37.566550 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:37.566567 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:37.566789 (+ 222us) server_negotiation.cc:407] Connection header received
0809 06:32:37.569059 (+ 2270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:37.569072 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:37.569395 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:37.569707 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:37.571199 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:37.572409 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:37.573936 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:37.574581 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:37.574755 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:38.783215 (+1208460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:40077: BlockingRecv error: recv got EOF from 127.30.78.65:40077 (error 108)
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":272,"threads_started":1}
W20260809 06:32:38.785259 11992 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:38249 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.78.126:38249: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Aug 09 06:32:38 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:38 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 06:32:38.798693 11994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:38.786604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:43449 (local address 127.30.78.126:38249)
0809 06:32:38.786814 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:38.786821 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:38.786849 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:32:38.786934 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:38.786940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:38.787031 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:38.787179 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:38.788192 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.789432 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.791602 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.792303 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.792425 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:38.798403 (+ 5978us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:43449: BlockingRecv error: recv got EOF from 127.30.78.65:43449 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 06:32:38.799501 11995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:38.786140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:43449)
0809 06:32:38.786583 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:38.786606 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:38.786741 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:38.787208 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:38.787213 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:38.787732 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:38.787974 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:38.787987 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.789642 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.789649 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:38.791399 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:38.791417 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.792700 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.792707 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:38.792921 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:38.793605 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:38.793632 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:38.799196 (+ 5564us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":290}
Aug 09 06:32:38 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:38 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
W20260809 06:32:38.813110 11994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:38.800822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:44723 (local address 127.30.78.126:38249)
0809 06:32:38.801008 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:38.801014 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:38.801438 (+ 424us) server_negotiation.cc:407] Connection header received
0809 06:32:38.801624 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:38.801629 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:38.801749 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:38.801855 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:38.803203 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.804416 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.806482 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.807188 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.807305 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:38.812844 (+ 5539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:44723: BlockingRecv error: recv got EOF from 127.30.78.65:44723 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:32:38.813915 12330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:38.800429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:44723)
0809 06:32:38.801308 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:38.801332 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:38.801496 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:38.802066 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:38.802073 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:38.802686 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:38.803015 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:38.803028 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.804612 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.804618 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:38.806291 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:38.806307 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.807547 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.807554 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:38.807760 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:38.808400 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:38.808426 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:38.813541 (+ 5115us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":712,"thread_start_us":568,"threads_started":1}
W20260809 06:32:38.814404 11992 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 06:32:38.819235 12210 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:42633
I20260809 06:32:38.819312 12422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:42633 every 8 connection(s)
I20260809 06:32:38.820765 12210 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:38.829072 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 12210
Aug 09 06:32:38 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:38 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:38.856330 12426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:38.830140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33898 (local address 127.30.78.126:38249)
0809 06:32:38.835605 (+ 5465us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:38.835612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:38.836745 (+ 1133us) server_negotiation.cc:407] Connection header received
0809 06:32:38.836943 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:38.836949 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:38.837021 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:38.837131 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:38.839332 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.840479 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.842476 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.843140 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.843278 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:38.846887 (+ 3609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:38.846898 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:38.846920 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:38.846974 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:38.850858 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:38.851702 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:38.851712 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:38.851722 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:38.851939 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:32:38.852456 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:32:38.852462 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:32:38.852466 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:32:38.853157 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:38.853573 (+ 416us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:38.855326 (+ 1753us) server_negotiation.cc:299] Negotiation successful
0809 06:32:38.855758 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5337,"thread_start_us":5204,"threads_started":1}
W20260809 06:32:39.113530 12209 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.077s user 0.001s sys 0.013s
W20260809 06:32:39.115041 12208 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:38.027845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:50507 (local address 127.30.78.126:38249)
0809 06:32:38.028371 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:38.028389 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:38.029185 (+ 796us) server_negotiation.cc:407] Connection header received
0809 06:32:38.031149 (+ 1964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:38.031154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:38.031240 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:38.031336 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:38.032911 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.033636 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.035202 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.035611 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.035727 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.114793 (+1079066us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:50507: BlockingRecv error: recv got EOF from 127.30.78.66:50507 (error 108)
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":270,"threads_started":1}
I20260809 06:32:39.116127 12209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:38.028224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:50507)
0809 06:32:38.029024 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:38.029067 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:38.030867 (+ 1800us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:38.031592 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:38.031603 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:38.032112 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:38.032741 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:38.032760 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.033807 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.033811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:38.035041 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:38.035056 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.035831 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.035839 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:38.036055 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:38.036637 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:38.036658 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:39.114682 (+1078024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":331,"threads_started":1}
W20260809 06:32:39.117128 12205 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:38249 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.78.126:38249: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:39.126286 12209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:39.117743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:43087)
0809 06:32:39.117921 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:39.117940 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:39.118049 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:39.118337 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:39.118342 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:39.118711 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:39.118882 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.118891 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.119901 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.119907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.120818 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.120829 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.121530 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.121537 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.121700 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.122414 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:39.122431 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:39.126010 (+ 3579us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 06:32:39.126431 12208 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:39.117838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:43087 (local address 127.30.78.126:38249)
0809 06:32:39.118001 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:39.118007 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:39.118025 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:32:39.118149 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:39.118155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:39.118220 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:39.118296 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:39.119023 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.119759 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.120957 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.121357 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.121469 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.126200 (+ 4731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:43087: BlockingRecv error: recv got EOF from 127.30.78.66:43087 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:39.135896 12209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:39.127066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:34317)
0809 06:32:39.127224 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:39.127242 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:39.127633 (+ 391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:39.127895 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:39.127899 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:39.128286 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:39.128448 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.128467 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.129469 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.129475 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.130430 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.130442 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.131137 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.131146 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.131403 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.132093 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:39.132123 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:39.135717 (+ 3594us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260809 06:32:39.136147 12205 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:32:39.136369 12208 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:39.127334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:34317 (local address 127.30.78.126:38249)
0809 06:32:39.127472 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:39.127475 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:39.127548 (+ 73us) server_negotiation.cc:407] Connection header received
0809 06:32:39.127725 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:39.127730 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:39.127784 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:39.127855 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:39.128611 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.129331 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.130556 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.130954 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.131065 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.136015 (+ 4950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:34317: BlockingRecv error: recv got EOF from 127.30.78.66:34317 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:39.828217 12431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:39.814988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:44933)
0809 06:32:39.815556 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:39.815579 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:39.815708 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:39.816240 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:39.816245 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:39.816713 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:39.816926 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.816938 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.818410 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.818416 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.819781 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.819798 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.820706 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.820712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.820893 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.824383 (+ 3490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:39.824407 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:39.827914 (+ 3507us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":304,"threads_started":1}
W20260809 06:32:39.828410 12433 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:39.815060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:44933 (local address 127.30.78.126:38249)
0809 06:32:39.815925 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:39.815936 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:39.815956 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:32:39.816009 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:39.816015 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:39.816088 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:39.816186 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:39.817062 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.818255 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.819959 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.820551 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.820674 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.828120 (+ 7446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:44933: BlockingRecv error: recv got EOF from 127.30.78.65:44933 (error 108)
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":522,"threads_started":1}
W20260809 06:32:39.836248 12425 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.001s user 0.000s sys 0.016s
W20260809 06:32:39.837263 11994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:38.823801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:43853 (local address 127.30.78.126:38249)
0809 06:32:38.823952 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:38.823956 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:38.825570 (+ 1614us) server_negotiation.cc:407] Connection header received
0809 06:32:38.827518 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:38.827524 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:38.827604 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:38.827694 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:38.829223 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.830087 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.832741 (+ 2654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.833509 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.833616 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.837074 (+1003458us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:43853: BlockingRecv error: recv got EOF from 127.30.78.67:43853 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 06:32:39.837926 12425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:38.824542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:43853)
0809 06:32:38.825421 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:38.825460 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:38.827257 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:38.827946 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:38.827955 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:38.828483 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:38.829042 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:38.829060 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.830308 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.830314 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:38.832511 (+ 2197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:38.832531 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:38.834039 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:38.834047 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:38.834404 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:38.835296 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:38.835339 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:39.836918 (+1001579us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":372,"threads_started":1}
W20260809 06:32:39.838776 12423 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:38249 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.78.126:38249: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:39.847389 12425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:39.839394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:47725)
0809 06:32:39.839595 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:39.839616 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:39.839725 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:39.840056 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:39.840061 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:39.840478 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:39.840682 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.840694 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.841703 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.841709 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.842687 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.842699 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.843389 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.843395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.843558 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.844039 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:39.844055 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:39.847183 (+ 3128us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 06:32:39.847550 11994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:39.839454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:47725 (local address 127.30.78.126:38249)
0809 06:32:39.839661 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:39.839666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:39.839682 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:32:39.839855 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:39.839860 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:39.839928 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:39.840006 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:39.840807 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.841573 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.842817 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.843219 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.843333 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.847358 (+ 4025us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:47725: BlockingRecv error: recv got EOF from 127.30.78.67:47725 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:39 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:39.855291 12425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:39.848020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:50723)
0809 06:32:39.848163 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:39.848178 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:39.848252 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:39.848485 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:39.848488 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:39.848742 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:39.848886 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.848894 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.849931 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.849935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.850861 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:39.850873 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.851594 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.851600 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:39.851783 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.852271 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:39.852287 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:39.855049 (+ 2762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260809 06:32:39.855439 11994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:39.848087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:50723 (local address 127.30.78.126:38249)
0809 06:32:39.848227 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:39.848231 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:39.848246 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:32:39.848323 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:39.848326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:39.848385 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:39.848454 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:39.848982 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.849771 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.850991 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:39.851453 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:39.851567 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:39.855233 (+ 3666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:50723: BlockingRecv error: recv got EOF from 127.30.78.67:50723 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260809 06:32:39.855613 12423 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 09 06:32:40 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:40 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:40.145220 12434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:40.136706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:59971)
0809 06:32:40.137222 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:40.137238 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:40.137351 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:40.137629 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:40.137632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:40.138074 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:40.138238 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:40.138247 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.139230 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.139234 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:40.140463 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:40.140480 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.141204 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.141211 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:40.141377 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:40.141925 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:40.141942 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:40.144995 (+ 3053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":285,"threads_started":1}
W20260809 06:32:40.145401 11994 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:40.136844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:59971 (local address 127.30.78.126:38249)
0809 06:32:40.137018 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:40.137022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:40.137301 (+ 279us) server_negotiation.cc:407] Connection header received
0809 06:32:40.137462 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:40.137466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:40.137524 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:40.137601 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:40.138342 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.139085 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.140596 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.141022 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.141126 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:40.145187 (+ 4061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:59971: BlockingRecv error: recv got EOF from 127.30.78.66:59971 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 06:32:40 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:40 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:40.837600 12435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:40.829338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:33673)
0809 06:32:40.829937 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:40.829954 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:40.830055 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:40.830321 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:40.830324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:40.830699 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:40.830869 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:40.830891 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.831857 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.831860 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:40.832778 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:40.832788 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.833397 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.833401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:40.833515 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:40.834123 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:40.834142 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:40.837267 (+ 3125us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":256,"threads_started":1}
W20260809 06:32:40.837771 12436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:40.829383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:33673 (local address 127.30.78.126:38249)
0809 06:32:40.830025 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:40.830029 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:40.830046 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:32:40.830148 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:40.830152 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:40.830208 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:40.830288 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:40.830996 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.831749 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.832880 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.833296 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.833391 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:40.837504 (+ 4113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:33673: BlockingRecv error: recv got EOF from 127.30.78.65:33673 (error 108)
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":440,"threads_started":1}
Aug 09 06:32:40 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:40 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:40.865074 12437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:40.856133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:46283)
0809 06:32:40.856678 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:40.856693 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:40.856821 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:40.857150 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:40.857153 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:40.857559 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:40.857770 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:40.857784 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.858810 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.858814 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:40.859773 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:40.859795 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.860445 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.860449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:40.860569 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:40.861072 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:40.861090 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:40.864754 (+ 3664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":307,"threads_started":1}
W20260809 06:32:40.865182 12436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:40.856173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:46283 (local address 127.30.78.126:38249)
0809 06:32:40.856311 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:40.856315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:40.856752 (+ 437us) server_negotiation.cc:407] Connection header received
0809 06:32:40.856927 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:40.856946 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:40.857019 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:40.857096 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:40.857888 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.858597 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.859902 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:40.860308 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:40.860400 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:40.864972 (+ 4572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:46283: BlockingRecv error: recv got EOF from 127.30.78.67:46283 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 06:32:41 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:41 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:41.154788 12440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:41.146066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:51805)
0809 06:32:41.146549 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:41.146564 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:41.146689 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:41.146989 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:41.146993 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:41.147413 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:41.147585 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:41.147594 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.148590 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.148593 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:41.149522 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:41.149534 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.150405 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.150410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:41.150600 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:41.151214 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:41.151232 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:41.154540 (+ 3308us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":263,"threads_started":1}
W20260809 06:32:41.154958 12436 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:41.146155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:51805 (local address 127.30.78.126:38249)
0809 06:32:41.146351 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:41.146357 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:41.146639 (+ 282us) server_negotiation.cc:407] Connection header received
0809 06:32:41.146796 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:41.146801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:41.146867 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:41.146946 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:41.147719 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.148454 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.149654 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.150276 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.150406 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:41.154721 (+ 4315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:51805: BlockingRecv error: recv got EOF from 127.30.78.66:51805 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 09 06:32:41 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:41 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:41.846956 12441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:41.838561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:44199)
0809 06:32:41.839057 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:41.839073 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:41.839171 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:41.839696 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:41.839701 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:41.840181 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:41.840354 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:41.840363 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.841374 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.841379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:41.842339 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:41.842351 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.842966 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.842970 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:41.843085 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:41.843596 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:41.843612 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:41.846725 (+ 3113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":256,"threads_started":1}
W20260809 06:32:41.847131 12443 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:41.838774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:44199 (local address 127.30.78.126:38249)
0809 06:32:41.839371 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:41.839385 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:41.839404 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:32:41.839456 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:41.839460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:41.839534 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:41.839636 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:41.840486 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.841243 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.842470 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.842861 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.842952 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:41.846907 (+ 3955us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:44199: BlockingRecv error: recv got EOF from 127.30.78.65:44199 (error 108)
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":346,"threads_started":1}
Aug 09 06:32:41 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:41 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:41.874109 12445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:41.865931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:48203)
0809 06:32:41.866462 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:41.866478 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:41.866582 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:41.866821 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:41.866823 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:41.867245 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:41.867436 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:41.867446 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.868420 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.868424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:41.869312 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:41.869323 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.869981 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.869985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:41.870119 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:41.870599 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:41.870615 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:41.873768 (+ 3153us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":298,"threads_started":1}
W20260809 06:32:41.874161 12443 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:41.865962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:48203 (local address 127.30.78.126:38249)
0809 06:32:41.866113 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:41.866117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:41.866538 (+ 421us) server_negotiation.cc:407] Connection header received
0809 06:32:41.866662 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:41.866666 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:41.866722 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:41.866795 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:41.867564 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.868300 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.869431 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:41.869861 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:41.869957 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:41.873924 (+ 3967us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:48203: BlockingRecv error: recv got EOF from 127.30.78.67:48203 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 09 06:32:42 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:42 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:42.164271 12446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:42.155610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:52221)
0809 06:32:42.156091 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:42.156108 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:42.156219 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:42.156490 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:42.156493 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:42.156900 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:42.157061 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:42.157070 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.158123 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.158127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:42.159214 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:42.159229 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.160108 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.160112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:42.160231 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:42.160792 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:42.160809 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:42.164037 (+ 3228us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":246,"threads_started":1}
W20260809 06:32:42.164435 12443 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:42.155682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:52221 (local address 127.30.78.126:38249)
0809 06:32:42.155844 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:42.155848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:42.156169 (+ 321us) server_negotiation.cc:407] Connection header received
0809 06:32:42.156300 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:42.156304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:42.156384 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:42.156462 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:42.157189 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.158003 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.159363 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.159973 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.160091 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:42.164210 (+ 4119us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:52221: BlockingRecv error: recv got EOF from 127.30.78.66:52221 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 06:32:42 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:42 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:42.859648 12447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:42.847945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:38583)
0809 06:32:42.849555 (+ 1610us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:42.849573 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:42.849696 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:42.850497 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:42.850502 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:42.851037 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:42.851252 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:42.851266 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.852668 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.852674 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:42.854237 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:42.854253 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.855030 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.855036 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:42.855190 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:42.855705 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:42.855723 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:42.859315 (+ 3592us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1488,"thread_start_us":1352,"threads_started":1}
W20260809 06:32:42.862164 12449 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:42.848002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:38583 (local address 127.30.78.126:38249)
0809 06:32:42.850143 (+ 2141us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:42.850149 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:42.850169 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:32:42.850220 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:42.850224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:42.850304 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:42.850414 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:42.851422 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.852514 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.854387 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.854861 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.854991 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:42.861973 (+ 6982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:38583: BlockingRecv error: recv got EOF from 127.30.78.65:38583 (error 108)
Metrics: {"server-negotiator.queue_time_us":2039,"thread_start_us":1796,"threads_started":1}
Aug 09 06:32:42 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:42 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:42.882889 12450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:42.874922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:49795)
0809 06:32:42.875406 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:42.875421 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:42.875544 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:42.875821 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:42.875826 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:42.876192 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:42.876362 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:42.876373 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.877345 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.877350 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:42.878294 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:42.878306 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.878950 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.878956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:42.879117 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:42.879616 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:42.879632 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:42.882577 (+ 2945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":259,"threads_started":1}
W20260809 06:32:42.882982 12449 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:42.874999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:49795 (local address 127.30.78.126:38249)
0809 06:32:42.875241 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:42.875246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:42.875490 (+ 244us) server_negotiation.cc:407] Connection header received
0809 06:32:42.875643 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:42.875647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:42.875703 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:42.875779 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:42.876506 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.877215 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.878425 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:42.878815 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:42.878920 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:42.882779 (+ 3859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:49795: BlockingRecv error: recv got EOF from 127.30.78.67:49795 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
Aug 09 06:32:43 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:43 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:43.173736 12451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:43.165128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:39481)
0809 06:32:43.165651 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:43.165668 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:43.165810 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:43.166140 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:43.166143 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:43.166545 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:43.166746 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:43.166756 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.167782 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.167786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:43.168821 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:43.168834 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.169446 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.169450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:43.169565 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:43.170156 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:43.170174 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:43.173381 (+ 3207us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":288,"threads_started":1}
W20260809 06:32:43.173854 12449 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:43.165174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:39481 (local address 127.30.78.126:38249)
0809 06:32:43.165322 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:43.165326 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:43.165734 (+ 408us) server_negotiation.cc:407] Connection header received
0809 06:32:43.165927 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:43.165931 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:43.165990 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:43.166063 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:43.166857 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.167654 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.168944 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.169339 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.169431 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:43.173581 (+ 4150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:39481: BlockingRecv error: recv got EOF from 127.30.78.66:39481 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 06:32:43 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:43 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:43.868834 12452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:43.860567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:37579)
0809 06:32:43.861248 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:43.861264 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:43.861376 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:43.861635 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:43.861638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:43.862062 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:43.862219 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:43.862228 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.863252 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.863256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:43.864299 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:43.864312 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.864922 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.864926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:43.865040 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:43.865559 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:43.865576 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:43.868614 (+ 3038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":458,"threads_started":1}
W20260809 06:32:43.869011 12454 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:43.860610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:37579 (local address 127.30.78.126:38249)
0809 06:32:43.861138 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:43.861142 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:43.861327 (+ 185us) server_negotiation.cc:407] Connection header received
0809 06:32:43.861469 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:43.861472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:43.861532 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:43.861607 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:43.862327 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.863147 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.864414 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.864804 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.864892 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:43.868787 (+ 3895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:37579: BlockingRecv error: recv got EOF from 127.30.78.65:37579 (error 108)
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":299,"threads_started":1}
Aug 09 06:32:43 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:43 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:43.891943 12455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:43.883834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:56187)
0809 06:32:43.884340 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:43.884355 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:43.884467 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:43.884692 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:43.884695 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:43.885047 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:43.885198 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:43.885208 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.886164 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.886167 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:43.887123 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:43.887135 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.887697 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.887701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:43.887818 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:43.888355 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:43.888372 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:43.891638 (+ 3266us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":409,"thread_start_us":272,"threads_started":1}
W20260809 06:32:43.891968 12454 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:43.883856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:56187 (local address 127.30.78.126:38249)
0809 06:32:43.883998 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:43.884001 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:43.884421 (+ 420us) server_negotiation.cc:407] Connection header received
0809 06:32:43.884549 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:43.884553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:43.884606 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:43.884677 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:43.885301 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.886061 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.887225 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:43.887594 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:43.887683 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:43.891800 (+ 4117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:56187: BlockingRecv error: recv got EOF from 127.30.78.67:56187 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 06:32:44 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:44 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:44.183198 12456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:44.174721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:45997)
0809 06:32:44.175246 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:44.175261 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:44.175396 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:44.175722 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:44.175726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:44.176142 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:44.176311 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:44.176321 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.177299 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.177303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:44.178237 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:44.178249 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.178950 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.178956 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:44.179126 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:44.179651 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:44.179668 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:44.182920 (+ 3252us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":275,"threads_started":1}
W20260809 06:32:44.183400 12454 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:44.174869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:45997 (local address 127.30.78.126:38249)
0809 06:32:44.175066 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:44.175072 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:44.175338 (+ 266us) server_negotiation.cc:407] Connection header received
0809 06:32:44.175509 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:44.175514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:44.175589 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:44.175669 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:44.176451 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.177169 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.178376 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.178817 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.178933 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:44.183128 (+ 4195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:45997: BlockingRecv error: recv got EOF from 127.30.78.66:45997 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 09 06:32:44 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:44 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:44.880971 12459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:44.869654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:37725)
0809 06:32:44.870134 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:44.870150 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:44.870252 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:44.870518 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:44.870521 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:44.870909 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:44.871096 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:44.871105 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.872011 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.872014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:44.873024 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:44.873039 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.873852 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.873859 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:44.874012 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:44.877323 (+ 3311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:44.877340 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:44.880647 (+ 3307us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":251,"threads_started":1}
W20260809 06:32:44.881132 12460 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:44.869737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:37725 (local address 127.30.78.126:38249)
0809 06:32:44.870204 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:44.870209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:44.870224 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:32:44.870338 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:44.870341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:44.870406 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:44.870488 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:44.871200 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.871916 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.873134 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.873664 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.873815 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:44.880854 (+ 7039us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:37725: BlockingRecv error: recv got EOF from 127.30.78.65:37725 (error 108)
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":250,"threads_started":1}
Aug 09 06:32:44 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:44 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:44.900451 12461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:44.892690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:37437)
0809 06:32:44.893116 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:44.893131 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:44.893237 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:44.893481 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:44.893483 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:44.893899 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:44.894047 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:44.894056 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.895004 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.895007 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:44.895929 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:44.895944 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.896648 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.896652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:44.896844 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:44.897389 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:44.897406 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:44.900241 (+ 2835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":215,"threads_started":1}
W20260809 06:32:44.900600 12460 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:44.892754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:37437 (local address 127.30.78.126:38249)
0809 06:32:44.892936 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:44.892941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:44.893195 (+ 254us) server_negotiation.cc:407] Connection header received
0809 06:32:44.893315 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:44.893318 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:44.893381 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:44.893451 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:44.894160 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.894900 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.896059 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:44.896518 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:44.896637 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:44.900409 (+ 3772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:37437: BlockingRecv error: recv got EOF from 127.30.78.67:37437 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 09 06:32:45 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:45 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:45.192307 12464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:45.184077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:38461)
0809 06:32:45.184612 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:45.184632 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:45.184751 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:45.185042 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:45.185045 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:45.185426 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:45.185591 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:45.185600 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.186535 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.186538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:45.187446 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:45.187457 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.188037 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.188041 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:45.188157 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:45.188673 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:45.188689 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:45.191992 (+ 3303us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":282,"threads_started":1}
W20260809 06:32:45.192451 12460 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:45.184120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:38461 (local address 127.30.78.126:38249)
0809 06:32:45.184290 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:45.184296 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:45.184704 (+ 408us) server_negotiation.cc:407] Connection header received
0809 06:32:45.184850 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:45.184854 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:45.184938 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:45.185010 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:45.185702 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.186429 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.187551 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.187926 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.188014 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:45.192194 (+ 4180us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:38461: BlockingRecv error: recv got EOF from 127.30.78.66:38461 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 09 06:32:45 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:45 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:45.890898 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:45.881866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:53337)
0809 06:32:45.882450 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:45.882467 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:45.882573 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:45.883000 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:45.883003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:45.883446 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:45.883659 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:45.883674 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.884998 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.885002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:45.886009 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:45.886022 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.886648 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.886653 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:45.886757 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:45.887265 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:45.887281 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:45.890530 (+ 3249us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":247,"threads_started":1}
W20260809 06:32:45.890960 12467 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:45.881959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:53337 (local address 127.30.78.126:38249)
0809 06:32:45.882756 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:45.882760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:45.882775 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:32:45.882819 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:45.882822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:45.882887 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:45.882970 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:45.883814 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.884876 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.886116 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.886537 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.886626 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:45.890745 (+ 4119us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:53337: BlockingRecv error: recv got EOF from 127.30.78.65:53337 (error 108)
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":588,"threads_started":1}
Aug 09 06:32:45 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:45 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:45.909363 12468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:45.901232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:58985)
0809 06:32:45.901652 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:45.901670 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:45.901813 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:45.902050 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:45.902053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:45.902468 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:45.902631 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:45.902641 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.903567 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.903573 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:45.904488 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:45.904500 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.905168 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.905173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:45.905337 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:45.905837 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:45.905855 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:45.909146 (+ 3291us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":215,"threads_started":1}
W20260809 06:32:45.909489 12467 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:45.901341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:58985 (local address 127.30.78.126:38249)
0809 06:32:45.901485 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:45.901489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:45.901746 (+ 257us) server_negotiation.cc:407] Connection header received
0809 06:32:45.901890 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:45.901894 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:45.901949 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:45.902021 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:45.902735 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.903426 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.904624 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:45.905020 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:45.905123 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:45.909307 (+ 4184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:58985: BlockingRecv error: recv got EOF from 127.30.78.67:58985 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 09 06:32:46 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:46 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:46.201785 12471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:46.193302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:43797)
0809 06:32:46.193944 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:46.193960 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:46.194089 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:46.194435 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:46.194439 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:46.194835 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:46.195009 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:46.195019 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.195999 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.196003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:46.196933 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:46.196945 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.197629 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.197636 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:46.197817 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:46.198337 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:46.198353 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:46.201518 (+ 3165us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":321,"threads_started":1}
W20260809 06:32:46.201948 12467 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:46.193350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:43797 (local address 127.30.78.126:38249)
0809 06:32:46.193567 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:46.193572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:46.194044 (+ 472us) server_negotiation.cc:407] Connection header received
0809 06:32:46.194223 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:46.194227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:46.194291 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:46.194377 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:46.195154 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.195867 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.197072 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.197488 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.197592 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:46.201694 (+ 4102us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:43797: BlockingRecv error: recv got EOF from 127.30.78.66:43797 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 09 06:32:46 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:46 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:46.900184 12477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:46.891728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:49123)
0809 06:32:46.892448 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:46.892464 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:46.892579 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:46.892850 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:46.892853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:46.893247 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:46.893431 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:46.893439 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.894487 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.894492 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:46.895433 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:46.895447 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.896169 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.896175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:46.896328 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:46.896853 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:46.896871 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:46.899942 (+ 3071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":447,"threads_started":1}
W20260809 06:32:46.900373 12472 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:46.891793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:49123 (local address 127.30.78.126:38249)
0809 06:32:46.892303 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:46.892309 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:46.892533 (+ 224us) server_negotiation.cc:407] Connection header received
0809 06:32:46.892678 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:46.892682 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:46.892743 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:46.892820 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:46.893548 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.894334 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.895571 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.895991 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.896098 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:46.900153 (+ 4055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:49123: BlockingRecv error: recv got EOF from 127.30.78.65:49123 (error 108)
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":249,"threads_started":1}
Aug 09 06:32:46 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:46 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:46.918289 12478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:46.910171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:34683)
0809 06:32:46.910744 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:46.910759 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:46.910862 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:46.911094 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:46.911097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:46.911497 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:46.911662 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:46.911670 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.912545 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.912549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:46.913471 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:46.913483 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.914163 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.914168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:46.914285 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:46.914804 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:46.914821 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:46.918020 (+ 3199us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":268,"threads_started":1}
W20260809 06:32:46.918646 12472 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:46.910325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:34683 (local address 127.30.78.126:38249)
0809 06:32:46.910445 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:46.910449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:46.910817 (+ 368us) server_negotiation.cc:407] Connection header received
0809 06:32:46.910935 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:46.910938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:46.910993 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:46.911063 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:46.911761 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.912440 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.913579 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:46.914025 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:46.914113 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:46.918218 (+ 4105us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:34683: BlockingRecv error: recv got EOF from 127.30.78.67:34683 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 09 06:32:47 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:47 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:47.211517 12479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:47.202689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:60197)
0809 06:32:47.203255 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:47.203284 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:47.203406 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:47.203719 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:47.203722 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:47.204281 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:47.204476 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:47.204487 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.205801 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.205805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:47.206746 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:47.206757 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.207364 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.207376 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:47.207485 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:47.208018 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:47.208035 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:47.211211 (+ 3176us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":283,"threads_started":1}
W20260809 06:32:47.211659 12472 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:47.202776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:60197 (local address 127.30.78.126:38249)
0809 06:32:47.202931 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:47.202936 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:47.203339 (+ 403us) server_negotiation.cc:407] Connection header received
0809 06:32:47.203487 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:47.203491 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:47.203597 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:47.203692 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:47.204622 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.205634 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.206853 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.207235 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.207321 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:47.211431 (+ 4110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:60197: BlockingRecv error: recv got EOF from 127.30.78.66:60197 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 06:32:47 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:47 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:47.909821 12481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:47.901027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:58933)
0809 06:32:47.901523 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:47.901538 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:47.901646 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:47.901953 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:47.901957 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:47.902355 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:47.902513 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:47.902522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.903488 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.903492 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:47.904485 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:47.904498 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.905254 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.905259 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:47.905434 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:47.906057 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:47.906079 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:47.909474 (+ 3395us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":265,"threads_started":1}
W20260809 06:32:47.909956 12482 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:47.901091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:58933 (local address 127.30.78.126:38249)
0809 06:32:47.901526 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:47.901530 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:47.901601 (+ 71us) server_negotiation.cc:407] Connection header received
0809 06:32:47.901748 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:47.901752 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:47.901823 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:47.901913 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:47.902622 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.903362 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.904604 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.905111 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.905230 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:47.909685 (+ 4455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:58933: BlockingRecv error: recv got EOF from 127.30.78.65:58933 (error 108)
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":224,"threads_started":1}
Aug 09 06:32:47 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:47 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:47.927146 12483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:47.919195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:50717)
0809 06:32:47.919771 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:47.919786 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:47.919904 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:47.920146 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:47.920149 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:47.920519 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:47.920675 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:47.920683 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.921609 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.921613 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:47.922556 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:47.922570 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.923181 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.923186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:47.923296 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:47.923847 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:47.923863 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:47.926912 (+ 3049us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":338,"threads_started":1}
W20260809 06:32:47.927243 12482 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:47.919308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:50717 (local address 127.30.78.126:38249)
0809 06:32:47.919441 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:47.919445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:47.919856 (+ 411us) server_negotiation.cc:407] Connection header received
0809 06:32:47.919987 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:47.919991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:47.920047 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:47.920117 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:47.920780 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.921507 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.922662 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:47.923044 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:47.923129 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:47.927057 (+ 3928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:50717: BlockingRecv error: recv got EOF from 127.30.78.67:50717 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 06:32:48 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:48 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:48.220866 12484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:48.212559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:33999)
0809 06:32:48.213019 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:48.213034 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:48.213142 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:48.213414 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:48.213417 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:48.213840 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:48.214014 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:48.214023 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.214925 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.214928 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:48.216015 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:48.216032 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.216834 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.216839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:48.216968 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:48.217482 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:48.217498 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:48.220622 (+ 3124us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":238,"threads_started":1}
W20260809 06:32:48.221001 12482 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:48.212578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:33999 (local address 127.30.78.126:38249)
0809 06:32:48.212766 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:48.212775 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:48.213108 (+ 333us) server_negotiation.cc:407] Connection header received
0809 06:32:48.213237 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:48.213240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:48.213314 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:48.213385 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:48.214128 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.214813 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.216154 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.216704 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.216796 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:48.220803 (+ 4007us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:33999: BlockingRecv error: recv got EOF from 127.30.78.66:33999 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 09 06:32:48 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:48 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:48.918915 12485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:48.910657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:40977)
0809 06:32:48.911143 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:48.911159 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:48.911263 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:48.911524 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:48.911527 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:48.911897 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:48.912064 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:48.912073 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.912987 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.912990 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:48.914003 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:48.914017 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.914645 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.914649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:48.914757 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:48.915267 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:48.915283 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:48.918688 (+ 3405us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":232,"threads_started":1}
W20260809 06:32:48.919111 12488 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:48.910744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:40977 (local address 127.30.78.126:38249)
0809 06:32:48.911227 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:48.911232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:48.911248 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:32:48.911348 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:48.911351 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:48.911409 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:48.911491 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:48.912176 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.912873 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.914110 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.914537 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.914621 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:48.918872 (+ 4251us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:40977: BlockingRecv error: recv got EOF from 127.30.78.65:40977 (error 108)
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":259,"threads_started":1}
Aug 09 06:32:48 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:48 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:48.936095 12489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:48.928021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:58235)
0809 06:32:48.928668 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:48.928684 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:48.928792 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:48.929093 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:48.929098 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:48.929531 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:48.929677 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:48.929686 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.930626 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.930629 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:48.931536 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:48.931547 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.932158 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.932165 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:48.932335 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:48.932812 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:48.932828 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:48.935780 (+ 2952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":413,"threads_started":1}
W20260809 06:32:48.936170 12488 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:48.928040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:58235 (local address 127.30.78.126:38249)
0809 06:32:48.928197 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:48.928202 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:48.928758 (+ 556us) server_negotiation.cc:407] Connection header received
0809 06:32:48.928898 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:48.928902 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:48.928957 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:48.929028 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:48.929818 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.930510 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.931632 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:48.932009 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:48.932109 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:48.935964 (+ 3855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:58235: BlockingRecv error: recv got EOF from 127.30.78.67:58235 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 09 06:32:49 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:49 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:49.230131 12491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:49.221733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:60081)
0809 06:32:49.222247 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:49.222263 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:49.222392 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:49.222733 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:49.222738 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:49.223141 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:49.223294 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:49.223304 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.224326 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.224330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:49.225284 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:49.225296 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.226068 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.226074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:49.226226 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:49.226784 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:49.226801 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:49.229784 (+ 2983us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":291,"threads_started":1}
W20260809 06:32:49.230204 12488 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:49.221828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:60081 (local address 127.30.78.126:38249)
0809 06:32:49.222000 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:49.222007 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:49.222342 (+ 335us) server_negotiation.cc:407] Connection header received
0809 06:32:49.222505 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:49.222508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:49.222583 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:49.222661 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:49.223449 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.224166 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.225429 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.225898 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.226007 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:49.229981 (+ 3974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:60081: BlockingRecv error: recv got EOF from 127.30.78.66:60081 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 09 06:32:49 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:49 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:49.932200 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:49.919700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:55899)
0809 06:32:49.920220 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:49.920240 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:49.920348 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:49.920600 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:49.920603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:49.921018 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:49.921191 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:49.921201 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.922143 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.922146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:49.923054 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:49.923065 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.923682 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.923686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:49.923793 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:49.928634 (+ 4841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:49.928651 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:49.931979 (+ 3328us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":260,"threads_started":1}
W20260809 06:32:49.932468 12494 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:49.919860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:55899 (local address 127.30.78.126:38249)
0809 06:32:49.920340 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:49.920345 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:49.920362 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:32:49.920432 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:49.920436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:49.920491 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:49.920564 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:49.921299 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.922052 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.923157 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.923576 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.923660 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:49.932192 (+ 8532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:55899: BlockingRecv error: recv got EOF from 127.30.78.65:55899 (error 108)
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":257,"threads_started":1}
Aug 09 06:32:49 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:49 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:49.944602 12495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:49.936904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:35519)
0809 06:32:49.937395 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:49.937410 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:49.937513 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:49.937779 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:49.937783 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:49.938106 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:49.938260 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:49.938269 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.939191 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.939194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:49.940150 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:49.940161 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.940725 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.940728 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:49.940834 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:49.941348 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:49.941374 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:49.944271 (+ 2897us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":264,"threads_started":1}
W20260809 06:32:49.944629 12494 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:49.936950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:35519 (local address 127.30.78.126:38249)
0809 06:32:49.937078 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:49.937082 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:49.937467 (+ 385us) server_negotiation.cc:407] Connection header received
0809 06:32:49.937590 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:49.937594 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:49.937646 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:49.937742 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:49.938378 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.939086 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.940247 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:49.940621 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:49.940701 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:49.944430 (+ 3729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:35519: BlockingRecv error: recv got EOF from 127.30.78.67:35519 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 09 06:32:50 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:50 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:50.238890 12496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:50.230983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:42267)
0809 06:32:50.231417 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:50.231434 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:50.231550 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:50.231826 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:50.231829 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:50.232231 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:50.232412 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:50.232421 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.233333 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.233336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:50.234273 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:50.234285 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.234902 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.234906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:50.235020 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:50.235543 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:50.235559 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:50.238657 (+ 3098us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":217,"threads_started":1}
W20260809 06:32:50.239053 12494 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:50.231104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:42267 (local address 127.30.78.126:38249)
0809 06:32:50.231314 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:50.231319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:50.231508 (+ 189us) server_negotiation.cc:407] Connection header received
0809 06:32:50.231638 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:50.231641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:50.231715 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:50.231790 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:50.232518 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.233231 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.234390 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.234796 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.234883 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:50.238815 (+ 3932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:42267: BlockingRecv error: recv got EOF from 127.30.78.66:42267 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 09 06:32:50 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:50 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:50.941565 12497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:50.933047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:39653)
0809 06:32:50.933567 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:50.933583 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:50.933684 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:50.934151 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:50.934156 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:50.934588 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:50.934757 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:50.934767 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.935785 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.935789 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:50.936712 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:50.936724 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.937439 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.937445 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:50.937622 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:50.938166 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:50.938184 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:50.941315 (+ 3131us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":256,"threads_started":1}
W20260809 06:32:50.941737 12499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:50.933129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:39653 (local address 127.30.78.126:38249)
0809 06:32:50.933866 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:50.933870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:50.933885 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:32:50.933928 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:50.933932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:50.933989 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:50.934082 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:50.934908 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.935648 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.936857 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.937270 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.937384 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:50.941514 (+ 4130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:39653: BlockingRecv error: recv got EOF from 127.30.78.65:39653 (error 108)
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":513,"threads_started":1}
Aug 09 06:32:50 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:50 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:50.953464 12502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:50.945377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:45139)
0809 06:32:50.946035 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:50.946050 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:50.946170 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:50.946496 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:50.946502 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:50.946984 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:50.947224 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:50.947234 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.948135 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.948138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:50.949088 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:50.949099 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.949781 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.949787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:50.949948 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:50.950415 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:50.950431 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:50.953230 (+ 2799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":411,"threads_started":1}
W20260809 06:32:50.953560 12499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:50.945451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:45139 (local address 127.30.78.126:38249)
0809 06:32:50.945643 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:50.945650 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:50.946123 (+ 473us) server_negotiation.cc:407] Connection header received
0809 06:32:50.946293 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:50.946296 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:50.946350 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:50.946424 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:50.947339 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.948041 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.949199 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:50.949613 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:50.949749 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:50.953392 (+ 3643us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:45139: BlockingRecv error: recv got EOF from 127.30.78.67:45139 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 09 06:32:51 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:51 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:51.248405 12504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:51.239733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:47477)
0809 06:32:51.240292 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:51.240307 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:51.240438 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:51.240754 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:51.240760 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:51.241188 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:51.241364 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:51.241373 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.242409 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.242414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:51.243480 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:51.243494 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.244256 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.244262 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:51.244458 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:51.245027 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:51.245044 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:51.248074 (+ 3030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":313,"threads_started":1}
W20260809 06:32:51.248509 12499 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:51.239812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:47477 (local address 127.30.78.126:38249)
0809 06:32:51.239962 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:51.239968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:51.240401 (+ 433us) server_negotiation.cc:407] Connection header received
0809 06:32:51.240558 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:51.240562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:51.240622 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:51.240701 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:51.241508 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.242273 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.243623 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.244112 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.244231 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:51.248281 (+ 4050us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:47477: BlockingRecv error: recv got EOF from 127.30.78.66:47477 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 09 06:32:51 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:51 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:51.950934 12505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:51.942409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:52573)
0809 06:32:51.942854 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:51.942880 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:51.942989 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:51.943254 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:51.943257 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:51.943645 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:51.943798 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:51.943808 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.944789 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.944793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:51.946046 (+ 1253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:51.946064 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.946752 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.946756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:51.946897 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:51.947466 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:51.947483 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:51.950697 (+ 3214us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":234,"threads_started":1}
W20260809 06:32:51.951114 12506 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:51.942455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:52573 (local address 127.30.78.126:38249)
0809 06:32:51.942868 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:51.942873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:51.942928 (+ 55us) server_negotiation.cc:407] Connection header received
0809 06:32:51.943079 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:51.943082 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:51.943145 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:51.943221 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:51.943913 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.944671 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.946209 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.946640 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.946731 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:51.950881 (+ 4150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:52573: BlockingRecv error: recv got EOF from 127.30.78.65:52573 (error 108)
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":213,"threads_started":1}
Aug 09 06:32:51 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:51 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:51.962445 12507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:51.954246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:50291)
0809 06:32:51.954721 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:51.954737 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:51.954838 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:51.955070 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:51.955072 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:51.955432 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:51.955592 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:51.955600 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.956560 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.956565 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:51.957687 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:51.957701 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.958390 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.958397 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:51.958564 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:51.959076 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:51.959094 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:51.962069 (+ 2975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":242,"threads_started":1}
W20260809 06:32:51.962486 12506 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:51.954268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:50291 (local address 127.30.78.126:38249)
0809 06:32:51.954407 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:51.954411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:51.954795 (+ 384us) server_negotiation.cc:407] Connection header received
0809 06:32:51.954915 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:51.954919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:51.954970 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:51.955041 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:51.955698 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.956416 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.957831 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:51.958211 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:51.958313 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:51.962284 (+ 3971us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:50291: BlockingRecv error: recv got EOF from 127.30.78.67:50291 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 09 06:32:52 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:52 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:52.258220 12508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:52.249391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:41013)
0809 06:32:52.249963 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:52.249981 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:52.250117 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:52.250442 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:52.250447 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:52.250866 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:52.251043 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:52.251053 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.252179 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.252184 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:52.253124 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:52.253138 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.253799 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.253803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:52.253929 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:52.254444 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:52.254461 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:52.257991 (+ 3530us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":323,"threads_started":1}
W20260809 06:32:52.258404 12506 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:52.249558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:41013 (local address 127.30.78.126:38249)
0809 06:32:52.249780 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:52.249788 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:52.250077 (+ 289us) server_negotiation.cc:407] Connection header received
0809 06:32:52.250230 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:52.250235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:52.250315 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:52.250402 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:52.251186 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.252021 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.253244 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.253654 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.253795 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:52.258164 (+ 4369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:41013: BlockingRecv error: recv got EOF from 127.30.78.66:41013 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 09 06:32:52 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:52 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.65@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:52.960745 12509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:52.952003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.65:41921)
0809 06:32:52.952459 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:52.952475 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:52.952572 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:52.953069 (+ 497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:52.953075 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:52.953456 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:52.953644 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:52.953653 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.954629 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.954633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:52.955637 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:52.955653 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.956492 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.956496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:52.956658 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:52.957310 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:52.957328 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:52.960499 (+ 3171us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":220,"threads_started":1}
W20260809 06:32:52.960903 12512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:52.952061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:41921 (local address 127.30.78.126:38249)
0809 06:32:52.952750 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:52.952754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:52.952787 (+ 33us) server_negotiation.cc:407] Connection header received
0809 06:32:52.952831 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:52.952835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:52.952925 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:52.953008 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:52.953789 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.954515 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.955764 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.956348 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.956437 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:52.960683 (+ 4246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.65:41921: BlockingRecv error: recv got EOF from 127.30.78.65:41921 (error 108)
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":489,"threads_started":1}
Aug 09 06:32:52 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:52 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.67@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:52.971271 12514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:52.963383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.67:44821)
0809 06:32:52.963792 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:52.963808 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:52.963915 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:52.964145 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:52.964148 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:52.964494 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:52.964640 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:52.964648 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.965543 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.965546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:52.966466 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:52.966477 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.967085 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.967091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:52.967227 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:52.967843 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:52.967876 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:52.971065 (+ 3189us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":222,"threads_started":1}
W20260809 06:32:52.971439 12512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:52.963425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:44821 (local address 127.30.78.126:38249)
0809 06:32:52.963647 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:52.963653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:52.963871 (+ 218us) server_negotiation.cc:407] Connection header received
0809 06:32:52.963990 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:52.963994 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:52.964047 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:52.964118 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:52.964736 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.965442 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.966574 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:52.966968 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:52.967073 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:52.971236 (+ 4163us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.67:44821: BlockingRecv error: recv got EOF from 127.30.78.67:44821 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 09 06:32:53 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
Aug 09 06:32:53 dist-test-slave-cvwc krb5kdc[10900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.78.66@KRBTEST.COM for oryx/127.30.78.126@KRBTEST.COM, Server not found in Kerberos database
I20260809 06:32:53.268050 12515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:53.259327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:38249 (local address 127.30.78.66:37281)
0809 06:32:53.259814 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:53.259829 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:53.259966 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:53.260287 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:53.260293 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:53.260705 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:53.260895 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:53.260904 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.261955 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.261960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:53.263061 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:53.263074 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.263736 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.263742 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:53.263925 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:53.264474 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:32:53.264491 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:53.267814 (+ 3323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.78.126:38249: Server oryx/127.30.78.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":255,"threads_started":1}
W20260809 06:32:53.268289 12512 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:53.259459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:37281 (local address 127.30.78.126:38249)
0809 06:32:53.259654 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:53.259660 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:53.259907 (+ 247us) server_negotiation.cc:407] Connection header received
0809 06:32:53.260077 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:53.260081 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:53.260159 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:53.260239 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:53.261035 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.261826 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.263195 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.263588 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.263692 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:53.268036 (+ 4344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.78.66:37281: BlockingRecv error: recv got EOF from 127.30.78.66:37281 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:32:53.830209 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 11772
I20260809 06:32:53.841780 12517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:53.831203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37206 (local address 127.30.78.65:41845)
0809 06:32:53.831880 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:53.831887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:53.831917 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:32:53.831990 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:53.831996 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:53.832238 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:53.832425 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:53.833787 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.834848 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.835993 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.836524 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.836623 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:53.838902 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:53.838910 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:53.838923 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:53.838964 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:53.841242 (+ 2278us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.78.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 06:32:53.841529 (+ 287us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37206: Request ticket server kudu/127.30.78.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":331,"threads_started":1}
W20260809 06:32:53.841852 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 11772: Not authorized: Client connection negotiation failed: client connection to 127.30.78.65:41845: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.78.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 06:32:53.841902 12517 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37206: Request ticket server kudu/127.30.78.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 06:32:53.842070 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 11772
I20260809 06:32:53.866758 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 11999
I20260809 06:32:53.878500 12519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:53.867826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44052 (local address 127.30.78.66:43007)
0809 06:32:53.868463 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:53.868470 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:53.868497 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:32:53.868564 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:53.868570 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:53.868806 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:53.868987 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:53.870294 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.871325 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.872512 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.873051 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.873170 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:53.875578 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:53.875586 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:53.875599 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:53.875635 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:53.877870 (+ 2235us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.78.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 06:32:53.878198 (+ 328us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44052: Request ticket server kudu/127.30.78.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":329,"threads_started":1}
W20260809 06:32:53.878547 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 11999: Not authorized: Client connection negotiation failed: client connection to 127.30.78.66:43007: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.78.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 06:32:53.878599 12519 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44052: Request ticket server kudu/127.30.78.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 06:32:53.878672 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 11999
I20260809 06:32:53.904403 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 12210
I20260809 06:32:53.916328 12520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:53.905508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49932 (local address 127.30.78.67:42633)
0809 06:32:53.906099 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:53.906106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:53.906131 (+ 25us) server_negotiation.cc:407] Connection header received
0809 06:32:53.906204 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:53.906211 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:53.906445 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:53.906632 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:53.908012 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.909022 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.910300 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:53.910861 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:53.910982 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:53.913326 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:53.913335 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:53.913347 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:32:53.913391 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:53.915692 (+ 2301us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.78.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0809 06:32:53.916009 (+ 317us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49932: Request ticket server kudu/127.30.78.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":285,"threads_started":1}
W20260809 06:32:53.916358 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 12210: Not authorized: Client connection negotiation failed: client connection to 127.30.78.67:42633: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.30.78.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260809 06:32:53.916438 12520 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49932: Request ticket server kudu/127.30.78.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260809 06:32:53.916509 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 12210
I20260809 06:32:53.940222 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 11673
I20260809 06:32:53.941493 11762 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:54.055230 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 11673
2026-08-09T06:32:54Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21410 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-09T06:32:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:54Z Disabled control of system clock
I20260809 06:32:54.139487 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:41847
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:39357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:41847
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260809 06:32:54.453212 12525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:54.453493 12525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:54.453615 12525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:54.460764 12525 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:54.460862 12525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:54.460922 12525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:54.460999 12525 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:54.461056 12525 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:54.470208 12525 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:41847
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:41847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:54.471475 12525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:54.473150 12525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:54.484061 12537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:54.484254 12535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:54.484254 12541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:54.485165 12525 server_base.cc:1034] running on GCE node
I20260809 06:32:54.486001 12525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:54.487380 12525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:54.488576 12525 hybrid_clock.cc:648] HybridClock initialized: now 1786257174488536 us; error 35 us; skew 500 ppm
I20260809 06:32:54.488905 12525 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:54.491065 12525 webserver.cc:460] Webserver started at http://127.30.78.126:44045/ using document root <none> and password file <none>
I20260809 06:32:54.491734 12525 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:54.491834 12525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:54.492144 12525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:54.494979 12525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0"
format_stamp: "Formatted at 2026-08-09 06:32:54 on dist-test-slave-cvwc"
server_key: "0744852e5b108d0829762a72bda1adf8"
server_key_iv: "9355edb5f093511b88670ab1104e76b0"
server_key_version: "encryptionkey@0"
I20260809 06:32:54.495738 12525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0"
format_stamp: "Formatted at 2026-08-09 06:32:54 on dist-test-slave-cvwc"
server_key: "0744852e5b108d0829762a72bda1adf8"
server_key_iv: "9355edb5f093511b88670ab1104e76b0"
server_key_version: "encryptionkey@0"
I20260809 06:32:54.500540 12525 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:32:54.503660 12548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:54.504868 12525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:54.505025 12525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0"
format_stamp: "Formatted at 2026-08-09 06:32:54 on dist-test-slave-cvwc"
server_key: "0744852e5b108d0829762a72bda1adf8"
server_key_iv: "9355edb5f093511b88670ab1104e76b0"
server_key_version: "encryptionkey@0"
I20260809 06:32:54.505211 12525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:54.545214 12525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:54.546068 12525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:54.546339 12525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:54.563264 12525 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:41847
I20260809 06:32:54.563294 12631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:41847 every 8 connection(s)
I20260809 06:32:54.564558 12525 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:54.568256 12632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:54.569089 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 12525
I20260809 06:32:54.569267 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:54.569964 31033 external_mini_cluster.cc:1428] Setting key 2d6eaf04713aa722035c0058978b87d2
I20260809 06:32:54.581640 12632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0: Bootstrap starting.
I20260809 06:32:54.583187 12638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:54.571967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56506 (local address 127.30.78.126:41847)
0809 06:32:54.572891 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:54.572902 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:54.572948 (+ 46us) server_negotiation.cc:407] Connection header received
0809 06:32:54.574528 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:54.574549 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:54.575013 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:54.575323 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:54.575977 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:54.577180 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:54.579010 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:54.579688 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:54.579811 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:54.580989 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:54.580996 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:54.581008 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:54.581526 (+ 518us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:54.581611 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:54.581634 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:54.581740 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:54.581984 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 06:32:54.582272 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":317,"threads_started":1}
I20260809 06:32:54.584767 12632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:54.585853 12632 log.cc:824] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:54.588330 12632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0: No bootstrap required, opened a new log
I20260809 06:32:54.595505 12632 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41847 } }
I20260809 06:32:54.595945 12632 raft_consensus.cc:374] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:54.596048 12632 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4a3a3da8c7044fa85fa8c0bf7c61ba0, State: Initialized, Role: FOLLOWER
I20260809 06:32:54.596621 12632 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41847 } }
I20260809 06:32:54.596874 12632 raft_consensus.cc:388] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:54.597024 12632 raft_consensus.cc:482] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:54.597185 12632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:54.599347 12632 raft_consensus.cc:504] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41847 } }
I20260809 06:32:54.599797 12632 leader_election.cc:302] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4a3a3da8c7044fa85fa8c0bf7c61ba0; no voters:
I20260809 06:32:54.600301 12632 leader_election.cc:288] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:54.600411 12640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:54.601022 12640 raft_consensus.cc:686] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [term 1 LEADER]: Becoming Leader. State: Replica: b4a3a3da8c7044fa85fa8c0bf7c61ba0, State: Running, Role: LEADER
I20260809 06:32:54.601516 12640 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41847 } }
I20260809 06:32:54.602208 12632 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:54.604362 12642 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4a3a3da8c7044fa85fa8c0bf7c61ba0. Latest consensus state: current_term: 1 leader_uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41847 } } }
I20260809 06:32:54.605093 12642 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:54.604898 12641 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4a3a3da8c7044fa85fa8c0bf7c61ba0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41847 } } }
I20260809 06:32:54.605208 12641 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0 [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:54.606268 12657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:54.611547 12657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:54.619351 12657 catalog_manager.cc:1347] Generated new cluster ID: 1fa7b573dd0249c1be52f596fc2eeccb
I20260809 06:32:54.619446 12657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:54.627578 12657 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:54.629426 12657 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:54.639766 12657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b4a3a3da8c7044fa85fa8c0bf7c61ba0: Generated new TSK 0
I20260809 06:32:54.640528 12657 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:32:54.654976 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:41847
--builtin_ntp_servers=127.30.78.84:39357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260809 06:32:54.977406 12676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:54.977661 12676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:54.977788 12676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:54.984740 12676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:54.984841 12676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:54.984979 12676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:54.993669 12676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:41847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:54.994880 12676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:54.996587 12676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:55.008958 12681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:55.008993 12687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:55.008930 12682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:55.010178 12676 server_base.cc:1034] running on GCE node
I20260809 06:32:55.010733 12676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:55.011539 12676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:55.012727 12676 hybrid_clock.cc:648] HybridClock initialized: now 1786257175012683 us; error 31 us; skew 500 ppm
I20260809 06:32:55.012996 12676 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:55.017143 12676 webserver.cc:460] Webserver started at http://127.30.78.65:37933/ using document root <none> and password file <none>
I20260809 06:32:55.017850 12676 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:55.017946 12676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:55.018200 12676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:55.020792 12676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "0c4c11fa5bdd4ba797067ac64c340277"
format_stamp: "Formatted at 2026-08-09 06:32:55 on dist-test-slave-cvwc"
server_key: "aec21ffdf6a442d9df3b00c7062c38de"
server_key_iv: "d7901d00e4b0f6387b41ac727537e4d6"
server_key_version: "encryptionkey@0"
I20260809 06:32:55.021507 12676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "0c4c11fa5bdd4ba797067ac64c340277"
format_stamp: "Formatted at 2026-08-09 06:32:55 on dist-test-slave-cvwc"
server_key: "aec21ffdf6a442d9df3b00c7062c38de"
server_key_iv: "d7901d00e4b0f6387b41ac727537e4d6"
server_key_version: "encryptionkey@0"
I20260809 06:32:55.026204 12676 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 06:32:55.029311 12696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:55.030558 12676 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:32:55.030689 12676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "0c4c11fa5bdd4ba797067ac64c340277"
format_stamp: "Formatted at 2026-08-09 06:32:55 on dist-test-slave-cvwc"
server_key: "aec21ffdf6a442d9df3b00c7062c38de"
server_key_iv: "d7901d00e4b0f6387b41ac727537e4d6"
server_key_version: "encryptionkey@0"
I20260809 06:32:55.030870 12676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:55.044708 12676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:55.045390 12676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:55.045624 12676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:55.046470 12676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:55.047741 12676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:55.047832 12676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:55.047912 12676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:55.047966 12676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:55.077415 12676 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:39287
I20260809 06:32:55.077459 12876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:39287 every 8 connection(s)
I20260809 06:32:55.078722 12676 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:55.090538 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 12676
I20260809 06:32:55.090726 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:32:55.091491 31033 external_mini_cluster.cc:1428] Setting key 84e835d7dc8e68f3f5112aed2c0612f4
I20260809 06:32:55.094239 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:41847
--builtin_ntp_servers=127.30.78.84:39357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 06:32:55.094452 12638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:55.081922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:49389 (local address 127.30.78.126:41847)
0809 06:32:55.082165 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:55.082171 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:55.083821 (+ 1650us) server_negotiation.cc:407] Connection header received
0809 06:32:55.086402 (+ 2581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:55.086409 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:55.086505 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:55.086589 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:55.088571 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.089427 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.091600 (+ 2173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.092213 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.092364 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:55.093667 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:55.093673 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:55.093676 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:55.093694 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:55.093752 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:55.093768 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:55.093859 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:55.094070 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 06:32:55.094168 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260809 06:32:55.095404 12882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:55.082512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:41847 (local address 127.30.78.65:49389)
0809 06:32:55.083651 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:55.083699 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:55.086057 (+ 2358us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:55.087216 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:55.087231 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:55.087375 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:55.088379 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:55.088405 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.089585 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.089589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:55.091436 (+ 1847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:55.091452 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.092458 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.092467 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:55.092702 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:55.093367 (+ 665us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:55.093370 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:55.093408 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:55.093478 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:55.093867 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:55.093879 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:55.093886 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 06:32:55.094045 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 06:32:55.094418 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":342,"threads_started":1}
I20260809 06:32:55.096879 12877 heartbeater.cc:347] Connected to a master server at 127.30.78.126:41847
I20260809 06:32:55.097170 12877 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:55.098037 12877 heartbeater.cc:511] Master 127.30.78.126:41847 requested a full tablet report, sending...
I20260809 06:32:55.099979 12577 ts_manager.cc:194] Registered new tserver with Master: 0c4c11fa5bdd4ba797067ac64c340277 (127.30.78.65:39287)
I20260809 06:32:55.101395 12577 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.65:49389
W20260809 06:32:55.412935 12884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:55.413213 12884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:55.413300 12884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:55.420379 12884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:55.420465 12884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:55.420572 12884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:55.429291 12884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:41847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:55.430536 12884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:55.432224 12884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:55.445248 12893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:55.445283 12890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:55.445209 12897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:55.446110 12884 server_base.cc:1034] running on GCE node
I20260809 06:32:55.446769 12884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:55.447692 12884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:55.448925 12884 hybrid_clock.cc:648] HybridClock initialized: now 1786257175448855 us; error 59 us; skew 500 ppm
I20260809 06:32:55.449257 12884 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:55.451508 12884 webserver.cc:460] Webserver started at http://127.30.78.66:42205/ using document root <none> and password file <none>
I20260809 06:32:55.452200 12884 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:55.452312 12884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:55.452658 12884 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:55.455879 12884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "77797b3ac2de4fd5b96e479bac44a576"
format_stamp: "Formatted at 2026-08-09 06:32:55 on dist-test-slave-cvwc"
server_key: "a1a2ddd854ac8dc996c364167b5d728f"
server_key_iv: "36514d8ebe45ee17dcc50bfc1d2d09c6"
server_key_version: "encryptionkey@0"
I20260809 06:32:55.456684 12884 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "77797b3ac2de4fd5b96e479bac44a576"
format_stamp: "Formatted at 2026-08-09 06:32:55 on dist-test-slave-cvwc"
server_key: "a1a2ddd854ac8dc996c364167b5d728f"
server_key_iv: "36514d8ebe45ee17dcc50bfc1d2d09c6"
server_key_version: "encryptionkey@0"
I20260809 06:32:55.462236 12884 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:32:55.465978 12905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:55.467306 12884 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260809 06:32:55.467468 12884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "77797b3ac2de4fd5b96e479bac44a576"
format_stamp: "Formatted at 2026-08-09 06:32:55 on dist-test-slave-cvwc"
server_key: "a1a2ddd854ac8dc996c364167b5d728f"
server_key_iv: "36514d8ebe45ee17dcc50bfc1d2d09c6"
server_key_version: "encryptionkey@0"
I20260809 06:32:55.467674 12884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:55.498494 12884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:55.499341 12884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:55.499617 12884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:55.500537 12884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:55.501958 12884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:55.502053 12884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:55.502161 12884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:55.502229 12884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:55.533272 12884 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:42169
I20260809 06:32:55.533358 13079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:42169 every 8 connection(s)
I20260809 06:32:55.534693 12884 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:55.537774 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 12884
I20260809 06:32:55.537935 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:32:55.538429 31033 external_mini_cluster.cc:1428] Setting key 8b88f7f27e86a7e3bce94e3c517758a5
I20260809 06:32:55.541450 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:41847
--builtin_ntp_servers=127.30.78.84:39357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260809 06:32:55.548245 12638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:55.537240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:55699 (local address 127.30.78.126:41847)
0809 06:32:55.537460 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:55.537467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:55.539182 (+ 1715us) server_negotiation.cc:407] Connection header received
0809 06:32:55.541226 (+ 2044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:55.541230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:55.541336 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:55.541429 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:55.542778 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.543529 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.545527 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.546024 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.546133 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:55.547552 (+ 1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:55.547558 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:55.547562 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:55.547585 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:55.547619 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:55.547633 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:55.547713 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:55.547914 (+ 201us) server_negotiation.cc:299] Negotiation successful
0809 06:32:55.547994 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:32:55.551174 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:55.537864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:41847 (local address 127.30.78.66:55699)
0809 06:32:55.539010 (+ 1146us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:55.539059 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:55.540929 (+ 1870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:55.541702 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:55.541731 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:55.541837 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:55.542594 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:55.542618 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.543699 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.543704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:55.545377 (+ 1673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:55.545391 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.546237 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.546244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:55.546504 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:55.547208 (+ 704us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:55.547211 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:55.547268 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:55.547357 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:55.547717 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:55.547727 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:55.547734 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 06:32:55.547903 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 06:32:55.548249 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":352,"threads_started":1}
I20260809 06:32:55.552631 13083 heartbeater.cc:347] Connected to a master server at 127.30.78.126:41847
I20260809 06:32:55.552935 13083 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:55.553815 13083 heartbeater.cc:511] Master 127.30.78.126:41847 requested a full tablet report, sending...
I20260809 06:32:55.555302 12577 ts_manager.cc:194] Registered new tserver with Master: 77797b3ac2de4fd5b96e479bac44a576 (127.30.78.66:42169)
I20260809 06:32:55.556133 12577 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.66:55699
W20260809 06:32:55.870383 13088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:55.870644 13088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:55.870790 13088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:55.877905 13088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:55.877998 13088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:55.878141 13088 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:55.887032 13088 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:41847
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:55.888307 13088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:55.890062 13088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:55.902432 13098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:55.902405 13099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:55.902601 13101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:55.903281 13088 server_base.cc:1034] running on GCE node
I20260809 06:32:55.903853 13088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:55.904750 13088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:55.905982 13088 hybrid_clock.cc:648] HybridClock initialized: now 1786257175905923 us; error 46 us; skew 500 ppm
I20260809 06:32:55.906339 13088 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:55.908540 13088 webserver.cc:460] Webserver started at http://127.30.78.67:39035/ using document root <none> and password file <none>
I20260809 06:32:55.909241 13088 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:55.909348 13088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:55.909662 13088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:55.912416 13088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "2fc64ccb18cd4a72a220d0575e05d0dd"
format_stamp: "Formatted at 2026-08-09 06:32:55 on dist-test-slave-cvwc"
server_key: "4e1308f076107728c199d5ec2ba279b3"
server_key_iv: "2d3820e22d33581d5b1bf471825d80bb"
server_key_version: "encryptionkey@0"
I20260809 06:32:55.913166 13088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "2fc64ccb18cd4a72a220d0575e05d0dd"
format_stamp: "Formatted at 2026-08-09 06:32:55 on dist-test-slave-cvwc"
server_key: "4e1308f076107728c199d5ec2ba279b3"
server_key_iv: "2d3820e22d33581d5b1bf471825d80bb"
server_key_version: "encryptionkey@0"
I20260809 06:32:55.918066 13088 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260809 06:32:55.921372 13108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:55.922693 13088 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:32:55.922842 13088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "2fc64ccb18cd4a72a220d0575e05d0dd"
format_stamp: "Formatted at 2026-08-09 06:32:55 on dist-test-slave-cvwc"
server_key: "4e1308f076107728c199d5ec2ba279b3"
server_key_iv: "2d3820e22d33581d5b1bf471825d80bb"
server_key_version: "encryptionkey@0"
I20260809 06:32:55.923036 13088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:55.952883 13088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:55.953655 13088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:55.953964 13088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:55.954861 13088 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:55.956225 13088 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:55.956321 13088 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:55.956435 13088 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:55.956506 13088 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:55.986482 13088 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:36259
I20260809 06:32:55.986550 13273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:36259 every 8 connection(s)
I20260809 06:32:55.987751 13088 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:55.989161 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 13088
I20260809 06:32:55.989310 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:32:55.989914 31033 external_mini_cluster.cc:1428] Setting key 643922da5c3a5d02ebb3ffc601885399
I20260809 06:32:55.999948 12638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:55.990437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:47293 (local address 127.30.78.126:41847)
0809 06:32:55.990668 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:55.990674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:55.992175 (+ 1501us) server_negotiation.cc:407] Connection header received
0809 06:32:55.993979 (+ 1804us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:55.993984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:55.994064 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:55.994153 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:55.995194 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.995905 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.997377 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.997832 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.997950 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:55.999163 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:55.999169 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:55.999172 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:55.999189 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:55.999219 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:55.999231 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:55.999304 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:55.999537 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 06:32:55.999632 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 06:32:56.000815 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:55.990982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:41847 (local address 127.30.78.67:47293)
0809 06:32:55.992034 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:55.992076 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:55.993674 (+ 1598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:55.994411 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:55.994419 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:55.994502 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:55.995032 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:55.995049 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.996051 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.996055 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:55.997232 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:32:55.997244 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:32:55.998050 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:32:55.998058 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:32:55.998280 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:55.998872 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:55.998874 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:55.998909 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:55.998977 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:55.999325 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:55.999337 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:55.999343 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:32:55.999500 (+ 157us) client_negotiation.cc:240] Negotiation successful
0809 06:32:55.999849 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":348,"threads_started":1}
I20260809 06:32:56.001968 13274 heartbeater.cc:347] Connected to a master server at 127.30.78.126:41847
I20260809 06:32:56.002228 13274 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:56.002955 13274 heartbeater.cc:511] Master 127.30.78.126:41847 requested a full tablet report, sending...
I20260809 06:32:56.004395 12577 ts_manager.cc:194] Registered new tserver with Master: 2fc64ccb18cd4a72a220d0575e05d0dd (127.30.78.67:36259)
I20260809 06:32:56.005304 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:32:56.005395 12577 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.67:47293
W20260809 06:32:56.011413 12638 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:56.009968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56522 (local address 127.30.78.126:41847)
0809 06:32:56.010105 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:56.010108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:56.010619 (+ 511us) server_negotiation.cc:407] Connection header received
0809 06:32:56.010745 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:56.010748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:56.010803 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:56.010883 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:56.011194 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56522: BlockingRecv error: recv got EOF from 127.0.0.1:56522 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 06:32:56.012257 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 12676
I20260809 06:32:56.019694 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:56.013125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33304 (local address 127.30.78.65:39287)
0809 06:32:56.013621 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:56.013628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:56.013649 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:32:56.013738 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:56.013746 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:56.013940 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:56.014080 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:56.014512 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:56.015479 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:56.016731 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:56.017239 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:56.017350 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:56.018329 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:56.018337 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:56.018347 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:56.018909 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:56.018958 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:56.018977 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:56.019075 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:56.019237 (+ 162us) server_negotiation.cc:299] Negotiation successful
0809 06:32:56.019387 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":258,"threads_started":1}
I20260809 06:32:56.020781 12870 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:56.100224 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 12676
I20260809 06:32:56.117164 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 12884
I20260809 06:32:56.124790 13289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:56.118091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56544 (local address 127.30.78.66:42169)
0809 06:32:56.118622 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:56.118628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:56.118655 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:32:56.118726 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:56.118732 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:56.118941 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:56.119089 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:56.119507 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:56.120491 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:56.121701 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:56.122338 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:56.122458 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:56.123410 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:56.123418 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:56.123430 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:56.123992 (+ 562us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:56.124050 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:56.124069 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:56.124168 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:56.124336 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 06:32:56.124472 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":262,"threads_started":1}
I20260809 06:32:56.126111 13072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:56.205281 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 12884
I20260809 06:32:56.226686 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 13088
I20260809 06:32:56.234925 13291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:56.227675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44312 (local address 127.30.78.67:36259)
0809 06:32:56.228340 (+ 665us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:56.228346 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:56.228378 (+ 32us) server_negotiation.cc:407] Connection header received
0809 06:32:56.228449 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:56.228455 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:56.228665 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:56.228824 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:56.229310 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:56.230416 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:56.231693 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:32:56.232244 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:32:56.232358 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:32:56.233396 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:56.233405 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:56.233418 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:56.234106 (+ 688us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:56.234163 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:56.234184 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:56.234297 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:56.234460 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 06:32:56.234598 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":357,"threads_started":1}
I20260809 06:32:56.236147 13266 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:56.318888 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 13088
I20260809 06:32:56.340530 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 12525
I20260809 06:32:56.341739 12624 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:56.441428 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 12525
2026-08-09T06:32:56Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2377 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-09T06:32:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:32:56Z Disabled control of system clock
I20260809 06:32:56.516363 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:44901
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:44901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 06:32:56.829030 13302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:56.829300 13302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:56.829437 13302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:56.836477 13302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:32:56.836576 13302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:56.836642 13302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:56.836724 13302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:32:56.836787 13302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:32:56.845682 13302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:44901
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:44901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:56.847218 13302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:56.849480 13302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:56.861029 13307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:56.861064 13312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:56.861086 13310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:56.862332 13302 server_base.cc:1034] running on GCE node
I20260809 06:32:56.863063 13302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:56.864312 13302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:56.865512 13302 hybrid_clock.cc:648] HybridClock initialized: now 1786257176865477 us; error 28 us; skew 500 ppm
I20260809 06:32:56.865872 13302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:56.868011 13302 webserver.cc:460] Webserver started at http://127.30.78.126:37985/ using document root <none> and password file <none>
I20260809 06:32:56.868667 13302 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:56.868757 13302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:56.869073 13302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:56.871901 13302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "35d28587ed554da08bbbebe87301ef7e"
format_stamp: "Formatted at 2026-08-09 06:32:56 on dist-test-slave-cvwc"
server_key: "5cb1807ac7509f9318a703deb076020e"
server_key_iv: "65e9af17fbc60d63ea41e7677a27a2f0"
server_key_version: "encryptionkey@0"
I20260809 06:32:56.872678 13302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "35d28587ed554da08bbbebe87301ef7e"
format_stamp: "Formatted at 2026-08-09 06:32:56 on dist-test-slave-cvwc"
server_key: "5cb1807ac7509f9318a703deb076020e"
server_key_iv: "65e9af17fbc60d63ea41e7677a27a2f0"
server_key_version: "encryptionkey@0"
I20260809 06:32:56.877538 13302 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:32:56.880713 13322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:56.882012 13302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:32:56.882170 13302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "35d28587ed554da08bbbebe87301ef7e"
format_stamp: "Formatted at 2026-08-09 06:32:56 on dist-test-slave-cvwc"
server_key: "5cb1807ac7509f9318a703deb076020e"
server_key_iv: "65e9af17fbc60d63ea41e7677a27a2f0"
server_key_version: "encryptionkey@0"
I20260809 06:32:56.882385 13302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:56.887778 13302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:56.888489 13302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:56.888749 13302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:56.905238 13302 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:44901
I20260809 06:32:56.905269 13397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:44901 every 8 connection(s)
I20260809 06:32:56.906466 13302 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:32:56.909862 13398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:32:56.913640 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 13302
I20260809 06:32:56.913861 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:32:56.914479 31033 external_mini_cluster.cc:1428] Setting key 769baa50ed7ab5b9328d29f49a5c2824
I20260809 06:32:56.920115 13398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e: Bootstrap starting.
I20260809 06:32:56.922662 13402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:56.916295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49542 (local address 127.30.78.126:44901)
0809 06:32:56.917301 (+ 1006us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:56.917314 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:56.917357 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:32:56.919065 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:56.919087 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:56.919455 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:56.919754 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:56.921050 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:56.921057 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:56.921070 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:56.921086 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:56.921154 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:56.921172 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:56.921369 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:56.921475 (+ 106us) server_negotiation.cc:299] Negotiation successful
0809 06:32:56.921747 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":359,"threads_started":1}
I20260809 06:32:56.923725 13398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e: Neither blocks nor log segments found. Creating new log.
I20260809 06:32:56.924788 13398 log.cc:824] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:32:56.927464 13398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e: No bootstrap required, opened a new log
I20260809 06:32:56.934361 13398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35d28587ed554da08bbbebe87301ef7e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44901 } }
I20260809 06:32:56.934790 13398 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:32:56.934911 13398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35d28587ed554da08bbbebe87301ef7e, State: Initialized, Role: FOLLOWER
I20260809 06:32:56.935479 13398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35d28587ed554da08bbbebe87301ef7e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44901 } }
I20260809 06:32:56.935690 13398 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:32:56.935825 13398 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:32:56.935971 13398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:32:56.938024 13398 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35d28587ed554da08bbbebe87301ef7e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44901 } }
I20260809 06:32:56.938504 13398 leader_election.cc:302] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35d28587ed554da08bbbebe87301ef7e; no voters:
I20260809 06:32:56.939069 13398 leader_election.cc:288] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:32:56.939198 13404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:32:56.939836 13404 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [term 1 LEADER]: Becoming Leader. State: Replica: 35d28587ed554da08bbbebe87301ef7e, State: Running, Role: LEADER
I20260809 06:32:56.940394 13404 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35d28587ed554da08bbbebe87301ef7e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44901 } }
I20260809 06:32:56.941165 13398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:32:56.943186 13406 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35d28587ed554da08bbbebe87301ef7e. Latest consensus state: current_term: 1 leader_uuid: "35d28587ed554da08bbbebe87301ef7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35d28587ed554da08bbbebe87301ef7e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44901 } } }
I20260809 06:32:56.943576 13406 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:56.943385 13405 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35d28587ed554da08bbbebe87301ef7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35d28587ed554da08bbbebe87301ef7e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44901 } } }
I20260809 06:32:56.943666 13405 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e [sys.catalog]: This master's current role is: LEADER
I20260809 06:32:56.945227 13413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:32:56.950054 13413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:32:56.959045 13413 catalog_manager.cc:1347] Generated new cluster ID: 57db617e4ff14b95842be2a16da4cd34
I20260809 06:32:56.959157 13413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:32:56.982319 13413 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:32:56.982725 13413 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:32:56.992517 13413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35d28587ed554da08bbbebe87301ef7e: Generated new TSK 0
I20260809 06:32:56.993301 13413 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:32:57.005481 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44901
--builtin_ntp_servers=127.30.78.84:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260809 06:32:57.326594 13427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:57.326843 13427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:57.326927 13427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:57.333851 13427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:57.333941 13427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:57.334053 13427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:32:57.343014 13427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:57.344213 13427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:57.346127 13427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:57.358299 13435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:57.358387 13434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:57.358359 13438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:57.359433 13427 server_base.cc:1034] running on GCE node
I20260809 06:32:57.360016 13427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:57.360857 13427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:57.362054 13427 hybrid_clock.cc:648] HybridClock initialized: now 1786257177362017 us; error 30 us; skew 500 ppm
I20260809 06:32:57.362349 13427 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:57.364465 13427 webserver.cc:460] Webserver started at http://127.30.78.65:43281/ using document root <none> and password file <none>
I20260809 06:32:57.365108 13427 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:57.365202 13427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:57.365513 13427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:57.370393 13427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "f3a48de89256415c8fe599d8fa4eb65d"
format_stamp: "Formatted at 2026-08-09 06:32:57 on dist-test-slave-cvwc"
server_key: "a4ce785cae6929eb836c15db9ca152ce"
server_key_iv: "215e29c440c30fe99d22bf49cdf0aaf8"
server_key_version: "encryptionkey@0"
I20260809 06:32:57.371158 13427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "f3a48de89256415c8fe599d8fa4eb65d"
format_stamp: "Formatted at 2026-08-09 06:32:57 on dist-test-slave-cvwc"
server_key: "a4ce785cae6929eb836c15db9ca152ce"
server_key_iv: "215e29c440c30fe99d22bf49cdf0aaf8"
server_key_version: "encryptionkey@0"
I20260809 06:32:57.376036 13427 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:32:57.379307 13446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:57.380517 13427 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:32:57.380666 13427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "f3a48de89256415c8fe599d8fa4eb65d"
format_stamp: "Formatted at 2026-08-09 06:32:57 on dist-test-slave-cvwc"
server_key: "a4ce785cae6929eb836c15db9ca152ce"
server_key_iv: "215e29c440c30fe99d22bf49cdf0aaf8"
server_key_version: "encryptionkey@0"
I20260809 06:32:57.380857 13427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:57.386509 13427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:57.387224 13427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:57.387463 13427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:57.388295 13427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:57.389629 13427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:57.389740 13427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:57.389853 13427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:57.389928 13427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:57.419515 13427 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:41745
I20260809 06:32:57.419567 13616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:41745 every 8 connection(s)
I20260809 06:32:57.420742 13427 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:32:57.428361 13620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:57.423145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:48663 (local address 127.30.78.126:44901)
0809 06:32:57.423580 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:57.423585 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:57.424617 (+ 1032us) server_negotiation.cc:407] Connection header received
0809 06:32:57.426280 (+ 1663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:57.426285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:57.426347 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:57.426451 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:57.427636 (+ 1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:57.427642 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:57.427647 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:57.427662 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:57.427701 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:57.427712 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:57.427814 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:57.428019 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 06:32:57.428082 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":211,"threads_started":1}
I20260809 06:32:57.429181 13622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:57.423660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:44901 (local address 127.30.78.65:48663)
0809 06:32:57.424475 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:57.424510 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:57.426015 (+ 1505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:57.426680 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:57.426688 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:57.426771 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:57.427355 (+ 584us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:57.427358 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:57.427395 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:57.427472 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:57.427804 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:57.427814 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:57.427822 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 06:32:57.428071 (+ 249us) client_negotiation.cc:240] Negotiation successful
0809 06:32:57.428293 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":241,"threads_started":1}
I20260809 06:32:57.429401 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 13427
I20260809 06:32:57.429600 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:32:57.430334 31033 external_mini_cluster.cc:1428] Setting key 8ee45276844303c1a9463ff1b68b78e4
I20260809 06:32:57.430660 13617 heartbeater.cc:347] Connected to a master server at 127.30.78.126:44901
I20260809 06:32:57.430963 13617 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:57.431553 13617 heartbeater.cc:511] Master 127.30.78.126:44901 requested a full tablet report, sending...
I20260809 06:32:57.433126 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44901
--builtin_ntp_servers=127.30.78.84:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 06:32:57.433583 13351 ts_manager.cc:194] Registered new tserver with Master: f3a48de89256415c8fe599d8fa4eb65d (127.30.78.65:41745)
W20260809 06:32:57.750068 13623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:57.750314 13623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:57.750409 13623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:57.757253 13623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:57.757344 13623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:57.757452 13623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:32:57.766258 13623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:57.767437 13623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:57.769162 13623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:57.781481 13633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:57.781510 13634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:57.781400 13639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:57.782544 13623 server_base.cc:1034] running on GCE node
I20260809 06:32:57.783119 13623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:57.784046 13623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:57.785265 13623 hybrid_clock.cc:648] HybridClock initialized: now 1786257177785208 us; error 40 us; skew 500 ppm
I20260809 06:32:57.785581 13623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:57.787681 13623 webserver.cc:460] Webserver started at http://127.30.78.66:42815/ using document root <none> and password file <none>
I20260809 06:32:57.788336 13623 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:57.788429 13623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:57.788740 13623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:57.791504 13623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "38dc967d348b4f8eb8cb096bb3003c99"
format_stamp: "Formatted at 2026-08-09 06:32:57 on dist-test-slave-cvwc"
server_key: "e3a016c4190672e56eb483cf79c06a25"
server_key_iv: "958b23b5332f6152ed1c3c89991164e2"
server_key_version: "encryptionkey@0"
I20260809 06:32:57.792261 13623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "38dc967d348b4f8eb8cb096bb3003c99"
format_stamp: "Formatted at 2026-08-09 06:32:57 on dist-test-slave-cvwc"
server_key: "e3a016c4190672e56eb483cf79c06a25"
server_key_iv: "958b23b5332f6152ed1c3c89991164e2"
server_key_version: "encryptionkey@0"
I20260809 06:32:57.797093 13623 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 06:32:57.800311 13651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:57.801558 13623 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:57.801699 13623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "38dc967d348b4f8eb8cb096bb3003c99"
format_stamp: "Formatted at 2026-08-09 06:32:57 on dist-test-slave-cvwc"
server_key: "e3a016c4190672e56eb483cf79c06a25"
server_key_iv: "958b23b5332f6152ed1c3c89991164e2"
server_key_version: "encryptionkey@0"
I20260809 06:32:57.801919 13623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:57.807099 13623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:57.807804 13623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:57.808029 13623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:57.808856 13623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:57.810171 13623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:57.810271 13623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:57.810379 13623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:57.810449 13623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:57.841645 13623 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:37495
I20260809 06:32:57.841665 13832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:37495 every 8 connection(s)
I20260809 06:32:57.842991 13623 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:32:57.845165 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 13623
I20260809 06:32:57.845342 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:32:57.845947 31033 external_mini_cluster.cc:1428] Setting key c98a3cee332c58cf449ea9e553ea400f
I20260809 06:32:57.848516 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44901
--builtin_ntp_servers=127.30.78.84:32877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260809 06:32:57.851321 13620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:57.845541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:44471 (local address 127.30.78.126:44901)
0809 06:32:57.845769 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:57.845775 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:57.847420 (+ 1645us) server_negotiation.cc:407] Connection header received
0809 06:32:57.849116 (+ 1696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:57.849122 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:57.849185 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:57.849280 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:57.850576 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:57.850583 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:57.850588 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:57.850607 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:57.850638 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:57.850649 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:57.850748 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:57.850957 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 06:32:57.851024 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:32:57.852172 13835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:57.846194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:44901 (local address 127.30.78.66:44471)
0809 06:32:57.847268 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:57.847325 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:57.848858 (+ 1533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:57.849533 (+ 675us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:57.849540 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:57.849631 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:57.850286 (+ 655us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:57.850289 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:57.850326 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:57.850404 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:57.850743 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:57.850762 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:57.850770 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 06:32:57.851019 (+ 249us) client_negotiation.cc:240] Negotiation successful
0809 06:32:57.851258 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":336,"threads_started":1}
I20260809 06:32:57.853492 13833 heartbeater.cc:347] Connected to a master server at 127.30.78.126:44901
I20260809 06:32:57.853797 13833 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:57.854439 13833 heartbeater.cc:511] Master 127.30.78.126:44901 requested a full tablet report, sending...
I20260809 06:32:57.855907 13351 ts_manager.cc:194] Registered new tserver with Master: 38dc967d348b4f8eb8cb096bb3003c99 (127.30.78.66:37495)
W20260809 06:32:58.177583 13838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:32:58.177871 13838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:32:58.177968 13838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:32:58.184996 13838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:32:58.185083 13838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:32:58.185204 13838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:32:58.194090 13838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44901
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:32:58.195268 13838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:32:58.196956 13838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:32:58.209558 13854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:58.209594 13847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:32:58.209666 13845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:32:58.210458 13838 server_base.cc:1034] running on GCE node
I20260809 06:32:58.210980 13838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:32:58.211790 13838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:32:58.212982 13838 hybrid_clock.cc:648] HybridClock initialized: now 1786257178212947 us; error 26 us; skew 500 ppm
I20260809 06:32:58.213243 13838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:32:58.215363 13838 webserver.cc:460] Webserver started at http://127.30.78.67:39189/ using document root <none> and password file <none>
I20260809 06:32:58.215973 13838 fs_manager.cc:359] Metadata directory not provided
I20260809 06:32:58.216058 13838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:32:58.216322 13838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:32:58.219137 13838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "f75fbb377dcb40648679326ae715c1f5"
format_stamp: "Formatted at 2026-08-09 06:32:58 on dist-test-slave-cvwc"
server_key: "f442f1a46234e2360211ce389c9c4508"
server_key_iv: "f48f79b424b9940609f32fd7cf1201c4"
server_key_version: "encryptionkey@0"
I20260809 06:32:58.219854 13838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "f75fbb377dcb40648679326ae715c1f5"
format_stamp: "Formatted at 2026-08-09 06:32:58 on dist-test-slave-cvwc"
server_key: "f442f1a46234e2360211ce389c9c4508"
server_key_iv: "f48f79b424b9940609f32fd7cf1201c4"
server_key_version: "encryptionkey@0"
I20260809 06:32:58.224714 13838 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 06:32:58.227910 13862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:58.229135 13838 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:32:58.229283 13838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "f75fbb377dcb40648679326ae715c1f5"
format_stamp: "Formatted at 2026-08-09 06:32:58 on dist-test-slave-cvwc"
server_key: "f442f1a46234e2360211ce389c9c4508"
server_key_iv: "f48f79b424b9940609f32fd7cf1201c4"
server_key_version: "encryptionkey@0"
I20260809 06:32:58.229491 13838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:32:58.234782 13838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:32:58.235530 13838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:32:58.235776 13838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:32:58.236613 13838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:32:58.238008 13838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:32:58.238102 13838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:58.238209 13838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:32:58.238281 13838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:32:58.269431 13838 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:35257
I20260809 06:32:58.269490 14040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:35257 every 8 connection(s)
I20260809 06:32:58.270826 13838 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:32:58.273329 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 13838
I20260809 06:32:58.273501 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:32:58.273986 31033 external_mini_cluster.cc:1428] Setting key de68db8e481ec81c283be412b6b66f22
I20260809 06:32:58.279642 13620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:58.273429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:38933 (local address 127.30.78.126:44901)
0809 06:32:58.273663 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:58.273670 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:58.275199 (+ 1529us) server_negotiation.cc:407] Connection header received
0809 06:32:58.277203 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:58.277209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:58.277274 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:58.277365 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:58.278736 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:58.278742 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:58.278747 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:58.278766 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:58.278798 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:58.278809 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:58.278930 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:58.279246 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 06:32:58.279319 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260809 06:32:58.280529 14048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:58.273975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:44901 (local address 127.30.78.67:38933)
0809 06:32:58.275045 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0809 06:32:58.275083 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 06:32:58.276940 (+ 1857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:32:58.277633 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:32:58.277643 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:32:58.277791 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:32:58.278432 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:32:58.278434 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:32:58.278487 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:32:58.278570 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:32:58.278902 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:32:58.278914 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:32:58.278921 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 06:32:58.279305 (+ 384us) client_negotiation.cc:240] Negotiation successful
0809 06:32:58.279549 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":345,"threads_started":1}
I20260809 06:32:58.281847 14041 heartbeater.cc:347] Connected to a master server at 127.30.78.126:44901
I20260809 06:32:58.282119 14041 heartbeater.cc:464] Registering TS with master...
I20260809 06:32:58.282691 14041 heartbeater.cc:511] Master 127.30.78.126:44901 requested a full tablet report, sending...
I20260809 06:32:58.284109 13351 ts_manager.cc:194] Registered new tserver with Master: f75fbb377dcb40648679326ae715c1f5 (127.30.78.67:35257)
I20260809 06:32:58.289628 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260809 06:32:58.295276 13620 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:32:58.293840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49558 (local address 127.30.78.126:44901)
0809 06:32:58.294021 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:58.294027 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:58.294535 (+ 508us) server_negotiation.cc:407] Connection header received
0809 06:32:58.294644 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:58.294647 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:58.294696 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:58.294772 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:58.295052 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49558: BlockingRecv error: recv got EOF from 127.0.0.1:49558 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:32:58.296080 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 13427
I20260809 06:32:58.299193 14056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:58.296900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47316 (local address 127.30.78.65:41745)
0809 06:32:58.297404 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:58.297410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:58.297434 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:32:58.297487 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:58.297492 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:58.297660 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:58.297830 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:58.298652 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:58.298658 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:58.298668 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:58.298685 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:58.298722 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:58.298735 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:58.298833 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:58.298893 (+ 60us) server_negotiation.cc:299] Negotiation successful
0809 06:32:58.298966 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":247,"threads_started":1}
I20260809 06:32:58.300349 13610 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:58.381577 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 13427
I20260809 06:32:58.403852 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 13623
I20260809 06:32:58.407275 14060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:58.404773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.30.78.66:37495)
0809 06:32:58.405286 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:58.405293 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:58.405319 (+ 26us) server_negotiation.cc:407] Connection header received
0809 06:32:58.405393 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:58.405399 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:58.405603 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:58.405751 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:58.406639 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:58.406646 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:58.406656 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:58.406668 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:58.406710 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:58.406724 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:58.406822 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:58.406889 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 06:32:58.406984 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":232,"threads_started":1}
I20260809 06:32:58.408452 13827 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:58.487790 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 13623
I20260809 06:32:58.507413 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 13838
I20260809 06:32:58.511152 14069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:32:58.508387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44160 (local address 127.30.78.67:35257)
0809 06:32:58.509032 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0809 06:32:58.509039 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:32:58.509067 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:32:58.509131 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:32:58.509137 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:32:58.509359 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:32:58.509482 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:32:58.510531 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:32:58.510537 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:32:58.510549 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:32:58.510565 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:32:58.510603 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:32:58.510616 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:32:58.510750 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 06:32:58.510803 (+ 53us) server_negotiation.cc:299] Negotiation successful
0809 06:32:58.510882 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":328,"threads_started":1}
I20260809 06:32:58.512342 14035 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:58.592653 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 13838
I20260809 06:32:58.616825 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 13302
I20260809 06:32:58.618008 13389 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:32:58.717327 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 13302
2026-08-09T06:32:58Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2275 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:32:58 dist-test-slave-cvwc krb5kdc[14074](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:32:58 dist-test-slave-cvwc krb5kdc[14074](info): set up 2 sockets
Aug 09 06:32:58 dist-test-slave-cvwc krb5kdc[14074](info): commencing operation
krb5kdc: starting...
W20260809 06:32:59.954668 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.195s user 0.003s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:33:00 dist-test-slave-cvwc krb5kdc[14074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:33:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:33:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:33:00.188488 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:34959
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:41697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:34959
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:33:00.506824 14091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:33:00.507102 14091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:33:00.507243 14091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:33:00.514119 14091 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:33:00.514223 14091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:33:00.514299 14091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:33:00.514389 14091 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:33:00.514449 14091 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:33:00.523651 14091 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:41697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:34959
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:34959
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:33:00.524974 14091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:33:00.526288 14091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:33:00.537371 14099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:00.537230 14100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:00.537384 14102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:33:00.538688 14091 server_base.cc:1034] running on GCE node
I20260809 06:33:00.539376 14091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:33:00.540576 14091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:33:00.541800 14091 hybrid_clock.cc:648] HybridClock initialized: now 1786257180541750 us; error 30 us; skew 500 ppm
I20260809 06:33:00.542136 14091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:33:00 dist-test-slave-cvwc krb5kdc[14074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257180, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:33:00.549098 14091 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:33:00.550580 14091 webserver.cc:460] Webserver started at http://127.30.78.126:43335/ using document root <none> and password file <none>
I20260809 06:33:00.551209 14091 fs_manager.cc:359] Metadata directory not provided
I20260809 06:33:00.551308 14091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:33:00.551558 14091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:33:00.554445 14091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "bf7132859eb44b14b3e9c618be943d83"
format_stamp: "Formatted at 2026-08-09 06:33:00 on dist-test-slave-cvwc"
server_key: "09569c9252e643ed6513db093435d9c5"
server_key_iv: "80693f8407a963d3c6dfea9791294927"
server_key_version: "encryptionkey@0"
I20260809 06:33:00.555143 14091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "bf7132859eb44b14b3e9c618be943d83"
format_stamp: "Formatted at 2026-08-09 06:33:00 on dist-test-slave-cvwc"
server_key: "09569c9252e643ed6513db093435d9c5"
server_key_iv: "80693f8407a963d3c6dfea9791294927"
server_key_version: "encryptionkey@0"
I20260809 06:33:00.559993 14091 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 06:33:00.563169 14114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:00.564404 14091 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:33:00.564544 14091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "bf7132859eb44b14b3e9c618be943d83"
format_stamp: "Formatted at 2026-08-09 06:33:00 on dist-test-slave-cvwc"
server_key: "09569c9252e643ed6513db093435d9c5"
server_key_iv: "80693f8407a963d3c6dfea9791294927"
server_key_version: "encryptionkey@0"
I20260809 06:33:00.564713 14091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:33:00.580114 14091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:33:00.583859 14091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:33:00.584116 14091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:33:00.601258 14091 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:34959
I20260809 06:33:00.601289 14198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:34959 every 8 connection(s)
I20260809 06:33:00.602572 14091 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:33:00.606146 14199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:33:00.608563 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 14091
I20260809 06:33:00.608763 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:33:00.609397 31033 external_mini_cluster.cc:1428] Setting key 237cb6b878cc69c74f39f1231e1ff3ef
I20260809 06:33:00.618566 14199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83: Bootstrap starting.
I20260809 06:33:00.622043 14199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83: Neither blocks nor log segments found. Creating new log.
I20260809 06:33:00.623008 14199 log.cc:824] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:33:00 dist-test-slave-cvwc krb5kdc[14074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:33:00.626107 14199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83: No bootstrap required, opened a new log
I20260809 06:33:00.632264 14202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:00.611395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36198 (local address 127.30.78.126:34959)
0809 06:33:00.612167 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:00.612182 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:00.612233 (+ 51us) server_negotiation.cc:407] Connection header received
0809 06:33:00.614427 (+ 2194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:00.614456 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:00.614949 (+ 493us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:00.615387 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:00.616673 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:00.618601 (+ 1928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:00.619905 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:00.620924 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:00.621097 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:00.625197 (+ 4100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:00.625206 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:00.625220 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:00.625257 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:00.628299 (+ 3042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:00.629114 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:00.629123 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:00.629129 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:00.629291 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:00.629696 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:00.629699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:00.629701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:00.630241 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:00.630478 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:00.630903 (+ 425us) server_negotiation.cc:299] Negotiation successful
0809 06:33:00.631241 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":315,"threads_started":1}
I20260809 06:33:00.634588 14199 raft_consensus.cc:348] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7132859eb44b14b3e9c618be943d83" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34959 } }
I20260809 06:33:00.634923 14199 raft_consensus.cc:374] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:33:00.635023 14199 raft_consensus.cc:729] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bf7132859eb44b14b3e9c618be943d83, State: Initialized, Role: FOLLOWER
I20260809 06:33:00.635532 14199 consensus_queue.cc:260] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7132859eb44b14b3e9c618be943d83" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34959 } }
I20260809 06:33:00.635743 14199 raft_consensus.cc:388] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:33:00.635867 14199 raft_consensus.cc:482] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:33:00.636014 14199 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:33:00.638113 14199 raft_consensus.cc:504] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7132859eb44b14b3e9c618be943d83" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34959 } }
I20260809 06:33:00.638599 14199 leader_election.cc:302] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bf7132859eb44b14b3e9c618be943d83; no voters:
I20260809 06:33:00.639156 14199 leader_election.cc:288] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:33:00.639284 14204 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:33:00.639931 14204 raft_consensus.cc:686] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [term 1 LEADER]: Becoming Leader. State: Replica: bf7132859eb44b14b3e9c618be943d83, State: Running, Role: LEADER
I20260809 06:33:00.640429 14204 consensus_queue.cc:237] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7132859eb44b14b3e9c618be943d83" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34959 } }
I20260809 06:33:00.641059 14199 sys_catalog.cc:564] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:33:00.643060 14205 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bf7132859eb44b14b3e9c618be943d83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7132859eb44b14b3e9c618be943d83" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34959 } } }
I20260809 06:33:00.643415 14205 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [sys.catalog]: This master's current role is: LEADER
I20260809 06:33:00.646998 14206 sys_catalog.cc:455] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bf7132859eb44b14b3e9c618be943d83. Latest consensus state: current_term: 1 leader_uuid: "bf7132859eb44b14b3e9c618be943d83" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bf7132859eb44b14b3e9c618be943d83" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34959 } } }
I20260809 06:33:00.647310 14206 sys_catalog.cc:458] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83 [sys.catalog]: This master's current role is: LEADER
I20260809 06:33:00.647965 14213 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:33:00.653002 14213 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:33:00.661937 14213 catalog_manager.cc:1347] Generated new cluster ID: 648d8ff49f664cbe9be82b21781e2022
I20260809 06:33:00.662032 14213 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:33:00.675654 14213 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:33:00.677460 14213 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:33:00.688191 14213 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83: Generated new TSK 0
I20260809 06:33:00.689008 14213 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:33:00.765424 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:34959
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:41697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:33:01.093111 14234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:33:01.093390 14234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:33:01.093541 14234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:33:01.100684 14234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:33:01.100805 14234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:33:01.100971 14234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:33:01.110878 14234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:41697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:34959
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:33:01.112106 14234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:33:01.113353 14234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:33:01.125823 14245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:01.125872 14243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:01.126016 14248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:33:01.127058 14234 server_base.cc:1034] running on GCE node
I20260809 06:33:01.127586 14234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:33:01.128399 14234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:33:01.129590 14234 hybrid_clock.cc:648] HybridClock initialized: now 1786257181129530 us; error 54 us; skew 500 ppm
I20260809 06:33:01.129895 14234 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:33:01 dist-test-slave-cvwc krb5kdc[14074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257181, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:33:01.132879 14234 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:33:01.134212 14234 webserver.cc:460] Webserver started at http://127.30.78.65:41549/ using document root <none> and password file <none>
I20260809 06:33:01.134833 14234 fs_manager.cc:359] Metadata directory not provided
I20260809 06:33:01.134940 14234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:33:01.135213 14234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:33:01.137988 14234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "6268661f91b64c33a5468d4ab1c42b44"
format_stamp: "Formatted at 2026-08-09 06:33:01 on dist-test-slave-cvwc"
server_key: "95b3c2a521544b441aca0da518c83f7d"
server_key_iv: "0791579c10ccd1bcc703b6f6b34cf039"
server_key_version: "encryptionkey@0"
I20260809 06:33:01.138726 14234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "6268661f91b64c33a5468d4ab1c42b44"
format_stamp: "Formatted at 2026-08-09 06:33:01 on dist-test-slave-cvwc"
server_key: "95b3c2a521544b441aca0da518c83f7d"
server_key_iv: "0791579c10ccd1bcc703b6f6b34cf039"
server_key_version: "encryptionkey@0"
I20260809 06:33:01.143509 14234 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:33:01.146633 14257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:01.147866 14234 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:33:01.148008 14234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "6268661f91b64c33a5468d4ab1c42b44"
format_stamp: "Formatted at 2026-08-09 06:33:01 on dist-test-slave-cvwc"
server_key: "95b3c2a521544b441aca0da518c83f7d"
server_key_iv: "0791579c10ccd1bcc703b6f6b34cf039"
server_key_version: "encryptionkey@0"
I20260809 06:33:01.148188 14234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:33:01.170617 14234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:33:01.174213 14234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:33:01.174489 14234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:33:01.175462 14234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:33:01.176717 14234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:33:01.176795 14234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:01.176901 14234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:33:01.176954 14234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:01.206691 14234 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:37851
I20260809 06:33:01.206755 14430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:37851 every 8 connection(s)
I20260809 06:33:01.207942 14234 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:33:01.210000 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 14234
I20260809 06:33:01.210189 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:33:01.210963 31033 external_mini_cluster.cc:1428] Setting key bf99e88f0b7e616e30e0278f32e21557
Aug 09 06:33:01 dist-test-slave-cvwc krb5kdc[14074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257181, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:33:01.228736 14435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:01.210384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:37921 (local address 127.30.78.126:34959)
0809 06:33:01.210884 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:01.210890 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:01.212085 (+ 1195us) server_negotiation.cc:407] Connection header received
0809 06:33:01.214075 (+ 1990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:01.214079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:01.214142 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:01.214230 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:01.216113 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:01.216802 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:01.218812 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:01.219201 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:01.219293 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:01.223179 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:01.223184 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:01.223187 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:01.223220 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:01.225831 (+ 2611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:01.226622 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:01.226625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:01.226627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:01.226738 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:01.227169 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:01.227171 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:01.227173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:01.227403 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:01.227508 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:01.228333 (+ 825us) server_negotiation.cc:299] Negotiation successful
0809 06:33:01.228489 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":239,"threads_started":1}
I20260809 06:33:01.230176 14436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:01.210885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:34959 (local address 127.30.78.65:37921)
0809 06:33:01.211693 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:01.211739 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:01.213786 (+ 2047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:01.214492 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:01.214502 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:01.215212 (+ 710us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:33:01.215957 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:01.215982 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:01.216966 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:01.216971 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:01.218677 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:01.218691 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:01.219423 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:01.219429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:01.219677 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:01.220359 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:33:01.220385 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:33:01.222961 (+ 2576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:33:01.225976 (+ 3015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:01.225984 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:01.225997 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:01.226519 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:01.226832 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:01.226837 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:01.226839 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:01.227077 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:01.227533 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:33:01.227540 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:33:01.227977 (+ 437us) client_negotiation.cc:769] Sending connection context
0809 06:33:01.228245 (+ 268us) client_negotiation.cc:240] Negotiation successful
0809 06:33:01.228716 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":298,"threads_started":1}
I20260809 06:33:01.231663 14432 heartbeater.cc:347] Connected to a master server at 127.30.78.126:34959
I20260809 06:33:01.231976 14432 heartbeater.cc:464] Registering TS with master...
I20260809 06:33:01.232820 14432 heartbeater.cc:511] Master 127.30.78.126:34959 requested a full tablet report, sending...
I20260809 06:33:01.234943 14141 ts_manager.cc:194] Registered new tserver with Master: 6268661f91b64c33a5468d4ab1c42b44 (127.30.78.65:37851)
I20260809 06:33:01.236330 14141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:37921
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:33:01.270421 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:34959
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:41697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:33:01.597968 14440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:33:01.598253 14440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:33:01.598363 14440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:33:01.608246 14440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:33:01.608389 14440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:33:01.608592 14440 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:33:01.623852 14440 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:41697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:34959
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:33:01.625051 14440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:33:01.626415 14440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:33:01.638937 14447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:01.639025 14452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:01.638979 14448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:33:01.640303 14440 server_base.cc:1034] running on GCE node
I20260809 06:33:01.640875 14440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:33:01.641760 14440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:33:01.642973 14440 hybrid_clock.cc:648] HybridClock initialized: now 1786257181642914 us; error 43 us; skew 500 ppm
I20260809 06:33:01.643281 14440 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:33:01 dist-test-slave-cvwc krb5kdc[14074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257181, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:33:01.646473 14440 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:33:01.647920 14440 webserver.cc:460] Webserver started at http://127.30.78.66:38661/ using document root <none> and password file <none>
I20260809 06:33:01.648597 14440 fs_manager.cc:359] Metadata directory not provided
I20260809 06:33:01.648738 14440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:33:01.649047 14440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:33:01.652112 14440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f"
format_stamp: "Formatted at 2026-08-09 06:33:01 on dist-test-slave-cvwc"
server_key: "e5870d7979251e4f7fd194a2cb7667c3"
server_key_iv: "7a6d0d8e1956e96dabd56a62dc50fea4"
server_key_version: "encryptionkey@0"
I20260809 06:33:01.652961 14440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f"
format_stamp: "Formatted at 2026-08-09 06:33:01 on dist-test-slave-cvwc"
server_key: "e5870d7979251e4f7fd194a2cb7667c3"
server_key_iv: "7a6d0d8e1956e96dabd56a62dc50fea4"
server_key_version: "encryptionkey@0"
I20260809 06:33:01.658017 14440 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260809 06:33:01.661326 14465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:01.662647 14440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:33:01.662792 14440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f"
format_stamp: "Formatted at 2026-08-09 06:33:01 on dist-test-slave-cvwc"
server_key: "e5870d7979251e4f7fd194a2cb7667c3"
server_key_iv: "7a6d0d8e1956e96dabd56a62dc50fea4"
server_key_version: "encryptionkey@0"
I20260809 06:33:01.662966 14440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:33:01.681456 14440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:33:01.685560 14440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:33:01.685889 14440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:33:01.686825 14440 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:33:01.688156 14440 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:33:01.688253 14440 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:01.688405 14440 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:33:01.688469 14440 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:01.719581 14440 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:46249
I20260809 06:33:01.719627 14647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:46249 every 8 connection(s)
I20260809 06:33:01.720779 14440 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:33:01.723666 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 14440
I20260809 06:33:01.723884 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:33:01.724447 31033 external_mini_cluster.cc:1428] Setting key cfad2753530f346555fbbe88e15c4de9
Aug 09 06:33:01 dist-test-slave-cvwc krb5kdc[14074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257181, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:33:01.740532 14435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:01.723228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:54155 (local address 127.30.78.126:34959)
0809 06:33:01.723412 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:01.723417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:01.724755 (+ 1338us) server_negotiation.cc:407] Connection header received
0809 06:33:01.726796 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:01.726802 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:01.726888 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:01.726974 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:01.728451 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:01.729146 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:01.730745 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:01.731160 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:01.731272 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:01.734850 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:01.734855 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:01.734858 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:01.734889 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:01.737568 (+ 2679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:01.738398 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:01.738403 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:01.738405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:01.738551 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:01.738988 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:01.738991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:01.738993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:01.739241 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:01.739347 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:01.740135 (+ 788us) server_negotiation.cc:299] Negotiation successful
0809 06:33:01.740292 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:33:01.741906 14650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:01.723792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:34959 (local address 127.30.78.66:54155)
0809 06:33:01.724590 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:01.724637 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:01.726535 (+ 1898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:01.727226 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:01.727234 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:01.727728 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:33:01.728278 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:01.728296 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:01.729311 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:01.729314 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:01.730600 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:01.730613 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:01.731389 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:01.731397 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:01.731615 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:01.732248 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:33:01.732275 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:33:01.734630 (+ 2355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:33:01.737707 (+ 3077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:01.737740 (+ 33us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:01.737754 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:01.738253 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:01.738660 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:01.738665 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:01.738669 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:01.738892 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:01.739374 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:33:01.739382 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:33:01.739791 (+ 409us) client_negotiation.cc:769] Sending connection context
0809 06:33:01.740068 (+ 277us) client_negotiation.cc:240] Negotiation successful
0809 06:33:01.740531 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":316,"threads_started":1}
I20260809 06:33:01.743240 14648 heartbeater.cc:347] Connected to a master server at 127.30.78.126:34959
I20260809 06:33:01.743542 14648 heartbeater.cc:464] Registering TS with master...
I20260809 06:33:01.744405 14648 heartbeater.cc:511] Master 127.30.78.126:34959 requested a full tablet report, sending...
I20260809 06:33:01.745909 14141 ts_manager.cc:194] Registered new tserver with Master: ea4539ceed0b4e61a7b20182e9a6cd9f (127.30.78.66:46249)
I20260809 06:33:01.746942 14141 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:54155
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:33:01.782648 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:34959
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:41697
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:33:02.105067 14653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:33:02.105331 14653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:33:02.105455 14653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:33:02.112361 14653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:33:02.112469 14653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:33:02.112624 14653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:33:02.121773 14653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:41697
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:34959
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:33:02.122962 14653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:33:02.124238 14653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:33:02.136722 14659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:02.136889 14660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:02.136947 14662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:33:02.137800 14653 server_base.cc:1034] running on GCE node
I20260809 06:33:02.138351 14653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:33:02.139228 14653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:33:02.140424 14653 hybrid_clock.cc:648] HybridClock initialized: now 1786257182140386 us; error 25 us; skew 500 ppm
I20260809 06:33:02.140723 14653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:33:02 dist-test-slave-cvwc krb5kdc[14074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257182, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:33:02.143828 14653 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:33:02.145102 14653 webserver.cc:460] Webserver started at http://127.30.78.67:41609/ using document root <none> and password file <none>
I20260809 06:33:02.145691 14653 fs_manager.cc:359] Metadata directory not provided
I20260809 06:33:02.145829 14653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:33:02.146095 14653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:33:02.148876 14653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "8265e5776eea4b64b65a418e0af543dc"
format_stamp: "Formatted at 2026-08-09 06:33:02 on dist-test-slave-cvwc"
server_key: "629101f58f795f50b2bcc9c5045f4aca"
server_key_iv: "f2eb59c680e90d0b45dca8a51e6d07a1"
server_key_version: "encryptionkey@0"
I20260809 06:33:02.149545 14653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "8265e5776eea4b64b65a418e0af543dc"
format_stamp: "Formatted at 2026-08-09 06:33:02 on dist-test-slave-cvwc"
server_key: "629101f58f795f50b2bcc9c5045f4aca"
server_key_iv: "f2eb59c680e90d0b45dca8a51e6d07a1"
server_key_version: "encryptionkey@0"
I20260809 06:33:02.154477 14653 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260809 06:33:02.157557 14672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:02.158918 14653 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:33:02.159071 14653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "8265e5776eea4b64b65a418e0af543dc"
format_stamp: "Formatted at 2026-08-09 06:33:02 on dist-test-slave-cvwc"
server_key: "629101f58f795f50b2bcc9c5045f4aca"
server_key_iv: "f2eb59c680e90d0b45dca8a51e6d07a1"
server_key_version: "encryptionkey@0"
I20260809 06:33:02.159266 14653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:33:02.183497 14653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:33:02.188066 14653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:33:02.188375 14653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:33:02.189389 14653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:33:02.190833 14653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:33:02.190917 14653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:02.191025 14653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:33:02.191090 14653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:02.224112 14653 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:41023
I20260809 06:33:02.224115 14843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:41023 every 8 connection(s)
I20260809 06:33:02.225425 14653 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:33:02.234467 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 14653
I20260809 06:33:02.234699 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:33:02.235262 31033 external_mini_cluster.cc:1428] Setting key 48bb2bdfa553757a9896e3ef2e7560e0
Aug 09 06:33:02 dist-test-slave-cvwc krb5kdc[14074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257182, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:33:02.239290 14432 heartbeater.cc:503] Master 127.30.78.126:34959 was elected leader, sending a full tablet report...
I20260809 06:33:02.245667 14435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.228032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:33295 (local address 127.30.78.126:34959)
0809 06:33:02.228220 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.228225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.229289 (+ 1064us) server_negotiation.cc:407] Connection header received
0809 06:33:02.231218 (+ 1929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.231223 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.231289 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.231367 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:02.232820 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.233542 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.235740 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.236260 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.236368 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.240335 (+ 3967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:02.240342 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:02.240346 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:02.240380 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:02.243120 (+ 2740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.243790 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.243794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.243797 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.243928 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.244306 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.244309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.244311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.244552 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:02.244656 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.245283 (+ 627us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.245435 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:33:02.246628 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.228393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:34959 (local address 127.30.78.67:33295)
0809 06:33:02.229114 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:02.229160 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:02.230925 (+ 1765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:02.231573 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:02.231580 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:02.232117 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:33:02.232670 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.232688 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.233692 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.233696 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.235593 (+ 1897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.235610 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.236482 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.236489 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.236740 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.237488 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:33:02.237524 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:33:02.240125 (+ 2601us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:33:02.243251 (+ 3126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:02.243257 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:02.243268 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:02.243685 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:02.244014 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:02.244017 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:02.244019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:02.244204 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:02.244655 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:33:02.244660 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:33:02.244948 (+ 288us) client_negotiation.cc:769] Sending connection context
0809 06:33:02.245195 (+ 247us) client_negotiation.cc:240] Negotiation successful
0809 06:33:02.245563 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":277,"threads_started":1}
I20260809 06:33:02.247913 14844 heartbeater.cc:347] Connected to a master server at 127.30.78.126:34959
I20260809 06:33:02.248199 14844 heartbeater.cc:464] Registering TS with master...
I20260809 06:33:02.249015 14844 heartbeater.cc:511] Master 127.30.78.126:34959 requested a full tablet report, sending...
I20260809 06:33:02.250901 14140 ts_manager.cc:194] Registered new tserver with Master: 8265e5776eea4b64b65a418e0af543dc (127.30.78.67:41023)
I20260809 06:33:02.251852 14140 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:33295
I20260809 06:33:02.262861 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:33:02.278389 14435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.267110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36204 (local address 127.30.78.126:34959)
0809 06:33:02.267263 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.267267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.267818 (+ 551us) server_negotiation.cc:407] Connection header received
0809 06:33:02.267953 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.267957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.268018 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.268095 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:02.269548 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.270318 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.271455 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.271826 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.271917 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.273946 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:02.273951 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:02.273955 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:02.273984 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:02.276358 (+ 2374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.276856 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.276859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.276861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.276975 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.277245 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.277247 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.277249 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.277548 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:02.277759 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.278007 (+ 248us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.278153 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 06:33:02.282037 14140 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36204:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:33:02.288622 14140 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:33:02.310853 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.299942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34110 (local address 127.30.78.65:37851)
0809 06:33:02.300547 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.300555 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.301244 (+ 689us) server_negotiation.cc:407] Connection header received
0809 06:33:02.301636 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.301644 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.301950 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.302112 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:02.303138 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.304817 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.307692 (+ 2875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.309239 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.309354 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.309587 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.310325 (+ 738us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.310501 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":303,"threads_started":1}
I20260809 06:33:02.311976 14868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.299732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37851 (local address 127.0.0.1:34110)
0809 06:33:02.301078 (+ 1346us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:02.301128 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:02.301391 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:02.302466 (+ 1075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:02.302474 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:02.302507 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:02.302926 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.302938 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.305031 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.305036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.307496 (+ 2460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.307513 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.309799 (+ 2286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.309806 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.310050 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.310102 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 06:33:02.311374 (+ 1272us) client_negotiation.cc:240] Negotiation successful
0809 06:33:02.311589 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1086,"thread_start_us":1302,"threads_started":1}
I20260809 06:33:02.316502 14324 tablet_service.cc:1467] Processing CreateTablet for tablet 124fd859e6464abe94eb1a492726ad60 (DEFAULT_TABLE table=test-table [id=8e48f69ad7ca4d4eb727fe8a7b2af719]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:33:02.318058 14324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 124fd859e6464abe94eb1a492726ad60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:33:02.321395 14868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.301469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:41023 (local address 127.0.0.1:42470)
0809 06:33:02.313585 (+ 12116us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:02.313602 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:02.313701 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:02.314825 (+ 1124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:02.314830 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:02.314854 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:02.315059 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.315073 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.317235 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.317240 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.318993 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.319024 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.320676 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.320682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.320845 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.320874 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 06:33:02.320962 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 06:33:02.321097 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12029,"thread_start_us":13717,"threads_started":1}
I20260809 06:33:02.321486 14872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.302019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42470 (local address 127.30.78.67:41023)
0809 06:33:02.314250 (+ 12231us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.314258 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.314292 (+ 34us) server_negotiation.cc:407] Connection header received
0809 06:33:02.314392 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.314399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.314627 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.315250 (+ 623us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:02.315528 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.317052 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.319180 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.320538 (+ 1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.320657 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.320884 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.321015 (+ 131us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.321163 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12067,"thread_start_us":14316,"threads_started":1}
I20260809 06:33:02.323240 14863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.299974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:46249 (local address 127.0.0.1:36122)
0809 06:33:02.301322 (+ 1348us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:02.301339 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:02.301439 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:02.316143 (+ 14704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:02.316148 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:02.316171 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:02.317041 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.317053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.318582 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.318588 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.320395 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.320410 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.322493 (+ 2083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.322500 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.322682 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.322716 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:33:02.322803 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 06:33:02.322938 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1212,"thread_start_us":711,"threads_started":1}
I20260809 06:33:02.324002 14870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.300466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36122 (local address 127.30.78.66:46249)
0809 06:33:02.315713 (+ 15247us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.315720 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.315742 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:33:02.315819 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.315824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.315964 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.316128 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:02.317249 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.318437 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.320583 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.322030 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.322166 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.322336 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.323513 (+ 1177us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.323677 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15113,"thread_start_us":15002,"threads_started":1}
I20260809 06:33:02.325244 14749 tablet_service.cc:1467] Processing CreateTablet for tablet 124fd859e6464abe94eb1a492726ad60 (DEFAULT_TABLE table=test-table [id=8e48f69ad7ca4d4eb727fe8a7b2af719]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:33:02.326355 14749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 124fd859e6464abe94eb1a492726ad60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:33:02.327598 14541 tablet_service.cc:1467] Processing CreateTablet for tablet 124fd859e6464abe94eb1a492726ad60 (DEFAULT_TABLE table=test-table [id=8e48f69ad7ca4d4eb727fe8a7b2af719]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:33:02.328848 14541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 124fd859e6464abe94eb1a492726ad60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:33:02.332126 14873 tablet_bootstrap.cc:492] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: Bootstrap starting.
I20260809 06:33:02.335996 14873 tablet_bootstrap.cc:654] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: Neither blocks nor log segments found. Creating new log.
I20260809 06:33:02.337239 14873 log.cc:824] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: Log is configured to *not* fsync() on all Append() calls
I20260809 06:33:02.340564 14873 tablet_bootstrap.cc:492] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: No bootstrap required, opened a new log
I20260809 06:33:02.340667 14877 tablet_bootstrap.cc:492] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: Bootstrap starting.
I20260809 06:33:02.340812 14873 ts_tablet_manager.cc:1397] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20260809 06:33:02.341588 14879 tablet_bootstrap.cc:492] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: Bootstrap starting.
I20260809 06:33:02.343683 14877 tablet_bootstrap.cc:654] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: Neither blocks nor log segments found. Creating new log.
I20260809 06:33:02.344600 14877 log.cc:824] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: Log is configured to *not* fsync() on all Append() calls
I20260809 06:33:02.344995 14879 tablet_bootstrap.cc:654] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: Neither blocks nor log segments found. Creating new log.
I20260809 06:33:02.346195 14879 log.cc:824] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: Log is configured to *not* fsync() on all Append() calls
I20260809 06:33:02.347138 14877 tablet_bootstrap.cc:492] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: No bootstrap required, opened a new log
I20260809 06:33:02.347419 14877 ts_tablet_manager.cc:1397] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 06:33:02.349001 14879 tablet_bootstrap.cc:492] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: No bootstrap required, opened a new log
I20260809 06:33:02.349243 14879 ts_tablet_manager.cc:1397] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260809 06:33:02.350530 14873 raft_consensus.cc:348] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } }
I20260809 06:33:02.350999 14873 raft_consensus.cc:374] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:33:02.351106 14873 raft_consensus.cc:729] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6268661f91b64c33a5468d4ab1c42b44, State: Initialized, Role: FOLLOWER
I20260809 06:33:02.351706 14873 consensus_queue.cc:260] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } }
I20260809 06:33:02.353425 14873 ts_tablet_manager.cc:1428] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: Time spent starting tablet: real 0.012s user 0.010s sys 0.001s
I20260809 06:33:02.355540 14877 raft_consensus.cc:348] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } }
I20260809 06:33:02.355854 14877 raft_consensus.cc:374] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:33:02.355952 14877 raft_consensus.cc:729] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8265e5776eea4b64b65a418e0af543dc, State: Initialized, Role: FOLLOWER
I20260809 06:33:02.356515 14877 consensus_queue.cc:260] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } }
I20260809 06:33:02.357749 14844 heartbeater.cc:503] Master 127.30.78.126:34959 was elected leader, sending a full tablet report...
I20260809 06:33:02.358173 14877 ts_tablet_manager.cc:1428] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260809 06:33:02.359828 14884 raft_consensus.cc:482] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:33:02.359825 14879 raft_consensus.cc:348] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } }
I20260809 06:33:02.360275 14879 raft_consensus.cc:374] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:33:02.360432 14879 raft_consensus.cc:729] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4539ceed0b4e61a7b20182e9a6cd9f, State: Initialized, Role: FOLLOWER
I20260809 06:33:02.360152 14884 raft_consensus.cc:504] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } }
I20260809 06:33:02.361016 14879 consensus_queue.cc:260] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } }
I20260809 06:33:02.363842 14884 leader_election.cc:288] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6268661f91b64c33a5468d4ab1c42b44 (127.30.78.65:37851), ea4539ceed0b4e61a7b20182e9a6cd9f (127.30.78.66:46249)
I20260809 06:33:02.366446 14648 heartbeater.cc:503] Master 127.30.78.126:34959 was elected leader, sending a full tablet report...
I20260809 06:33:02.367126 14879 ts_tablet_manager.cc:1428] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: Time spent starting tablet: real 0.018s user 0.013s sys 0.003s
I20260809 06:33:02.369539 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.363070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:45413 (local address 127.30.78.65:37851)
0809 06:33:02.363252 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.363258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.363278 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:33:02.363342 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.363348 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.363432 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.363518 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:02.363995 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.365031 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.367262 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.368423 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.368573 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.368646 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.369180 (+ 534us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.369313 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:33:02.369549 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.362583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37851 (local address 127.30.78.67:45413)
0809 06:33:02.362786 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:02.362805 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:02.362912 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:02.363629 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:02.363634 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:02.363660 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:02.363827 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.363836 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.365164 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.365170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.366993 (+ 1823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.367008 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.368765 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.368770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.369020 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.369055 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 06:33:02.369152 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 06:33:02.369277 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":20}
I20260809 06:33:02.370527 14355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124fd859e6464abe94eb1a492726ad60" candidate_uuid: "8265e5776eea4b64b65a418e0af543dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6268661f91b64c33a5468d4ab1c42b44" is_pre_election: true
I20260809 06:33:02.371052 14355 raft_consensus.cc:2454] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8265e5776eea4b64b65a418e0af543dc in term 0.
I20260809 06:33:02.371160 14870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.364171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:53363 (local address 127.30.78.66:46249)
0809 06:33:02.364356 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.364362 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.364849 (+ 487us) server_negotiation.cc:407] Connection header received
0809 06:33:02.365027 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.365033 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.365107 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.365195 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:02.366087 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.367190 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.369114 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.370305 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.370455 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.370522 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.370808 (+ 286us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.370941 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:33:02.371806 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.364229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:46249 (local address 127.30.78.67:53363)
0809 06:33:02.364732 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:02.364749 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:02.364864 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:02.365362 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:02.365372 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:02.365397 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:02.365897 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.365908 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.367422 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.367426 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.368971 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:02.368983 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.370495 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.370501 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:02.370636 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.370658 (+ 22us) client_negotiation.cc:769] Sending connection context
0809 06:33:02.371278 (+ 620us) client_negotiation.cc:240] Negotiation successful
0809 06:33:02.371389 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":1,"thread_start_us":267,"threads_started":1}
I20260809 06:33:02.371783 14675 leader_election.cc:302] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6268661f91b64c33a5468d4ab1c42b44, 8265e5776eea4b64b65a418e0af543dc; no voters:
I20260809 06:33:02.372200 14884 raft_consensus.cc:2781] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:33:02.372356 14884 raft_consensus.cc:482] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:33:02.372467 14884 raft_consensus.cc:3037] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:33:02.372632 14572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124fd859e6464abe94eb1a492726ad60" candidate_uuid: "8265e5776eea4b64b65a418e0af543dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" is_pre_election: true
I20260809 06:33:02.373018 14572 raft_consensus.cc:2454] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8265e5776eea4b64b65a418e0af543dc in term 0.
I20260809 06:33:02.374804 14884 raft_consensus.cc:504] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } }
I20260809 06:33:02.375379 14884 leader_election.cc:288] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [CANDIDATE]: Term 1 election: Requested vote from peers 6268661f91b64c33a5468d4ab1c42b44 (127.30.78.65:37851), ea4539ceed0b4e61a7b20182e9a6cd9f (127.30.78.66:46249)
I20260809 06:33:02.375751 14572 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124fd859e6464abe94eb1a492726ad60" candidate_uuid: "8265e5776eea4b64b65a418e0af543dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f"
I20260809 06:33:02.375814 14355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "124fd859e6464abe94eb1a492726ad60" candidate_uuid: "8265e5776eea4b64b65a418e0af543dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6268661f91b64c33a5468d4ab1c42b44"
I20260809 06:33:02.375914 14572 raft_consensus.cc:3037] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:33:02.376019 14355 raft_consensus.cc:3037] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:33:02.378103 14572 raft_consensus.cc:2454] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8265e5776eea4b64b65a418e0af543dc in term 1.
I20260809 06:33:02.378437 14678 leader_election.cc:302] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8265e5776eea4b64b65a418e0af543dc, ea4539ceed0b4e61a7b20182e9a6cd9f; no voters:
I20260809 06:33:02.378752 14355 raft_consensus.cc:2454] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8265e5776eea4b64b65a418e0af543dc in term 1.
I20260809 06:33:02.379109 14884 raft_consensus.cc:2781] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:33:02.379331 14884 raft_consensus.cc:686] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 1 LEADER]: Becoming Leader. State: Replica: 8265e5776eea4b64b65a418e0af543dc, State: Running, Role: LEADER
I20260809 06:33:02.379793 14884 consensus_queue.cc:237] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } }
I20260809 06:33:02.384406 14141 catalog_manager.cc:5495] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 8265e5776eea4b64b65a418e0af543dc (127.30.78.67). New cstate: current_term: 1 leader_uuid: "8265e5776eea4b64b65a418e0af543dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8265e5776eea4b64b65a418e0af543dc" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41023 } health_report { overall_health: HEALTHY } } }
I20260809 06:33:02.408911 14872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.404361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42486 (local address 127.30.78.67:41023)
0809 06:33:02.404571 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.404575 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.404638 (+ 63us) server_negotiation.cc:407] Connection header received
0809 06:33:02.404789 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.404793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.404864 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.404978 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:33:02.405267 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.406009 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.407194 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.407569 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.407650 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.408021 (+ 371us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:33:02.408470 (+ 449us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:33:02.408567 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.408621 (+ 54us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.408678 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 06:33:02.416589 14572 raft_consensus.cc:1261] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [term 1 FOLLOWER]: Refusing update from remote peer 8265e5776eea4b64b65a418e0af543dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:33:02.416587 14355 raft_consensus.cc:1261] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [term 1 FOLLOWER]: Refusing update from remote peer 8265e5776eea4b64b65a418e0af543dc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:33:02.417629 14885 consensus_queue.cc:1035] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea4539ceed0b4e61a7b20182e9a6cd9f" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 46249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:33:02.417999 14884 consensus_queue.cc:1035] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6268661f91b64c33a5468d4ab1c42b44" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:33:02.427980 14898 mvcc.cc:205] Tried to move back new op lower bound from 7316509419168247808 to 7316509419031752704. Current Snapshot: MvccSnapshot[applied={T|T < 7316509419168247808}]
I20260809 06:33:02.440861 14141 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:33:02.441280 14141 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36204:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:33:02.445482 14141 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bf7132859eb44b14b3e9c618be943d83: Sending DeleteTablet for 3 replicas of tablet 124fd859e6464abe94eb1a492726ad60
I20260809 06:33:02.446382 14541 tablet_service.cc:1514] Processing DeleteTablet for tablet 124fd859e6464abe94eb1a492726ad60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:33:02 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:36122
I20260809 06:33:02.446396 14324 tablet_service.cc:1514] Processing DeleteTablet for tablet 124fd859e6464abe94eb1a492726ad60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:33:02 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:34110
I20260809 06:33:02.447098 14749 tablet_service.cc:1514] Processing DeleteTablet for tablet 124fd859e6464abe94eb1a492726ad60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:33:02 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:42470
I20260809 06:33:02.447134 14540 tablet_service.cc:1514] Processing DeleteTablet for tablet 124fd859e6464abe94eb1a492726ad60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:33:02 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:36122
I20260809 06:33:02.454770 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 14234
I20260809 06:33:02.457293 14912 tablet_replica.cc:330] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: stopping tablet replica
I20260809 06:33:02.457628 14912 raft_consensus.cc:2229] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:33:02.458042 14912 raft_consensus.cc:2258] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:33:02.460222 14911 tablet_replica.cc:330] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: stopping tablet replica
I20260809 06:33:02.460224 14912 ts_tablet_manager.cc:1905] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:33:02.461038 14911 raft_consensus.cc:2229] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:33:02.461550 14911 raft_consensus.cc:2258] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:33:02.463527 14911 ts_tablet_manager.cc:1905] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:33:02.467070 14912 ts_tablet_manager.cc:1918] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:33:02.467283 14912 log.cc:1196] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/124fd859e6464abe94eb1a492726ad60
I20260809 06:33:02.467909 14912 ts_tablet_manager.cc:1939] T 124fd859e6464abe94eb1a492726ad60 P ea4539ceed0b4e61a7b20182e9a6cd9f: Deleting consensus metadata
I20260809 06:33:02.469673 14122 catalog_manager.cc:4841] TS ea4539ceed0b4e61a7b20182e9a6cd9f (127.30.78.66:46249): tablet 124fd859e6464abe94eb1a492726ad60 (table test-table [id=8e48f69ad7ca4d4eb727fe8a7b2af719]) successfully deleted
W20260809 06:33:02.470307 14122 catalog_manager.cc:4808] TS ea4539ceed0b4e61a7b20182e9a6cd9f (127.30.78.66:46249): delete failed for tablet 124fd859e6464abe94eb1a492726ad60 because the tablet was not found. No further retry: Not found: Tablet not found: 124fd859e6464abe94eb1a492726ad60
I20260809 06:33:02.470666 14911 ts_tablet_manager.cc:1918] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:33:02.470817 14911 log.cc:1196] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/124fd859e6464abe94eb1a492726ad60
I20260809 06:33:02.471211 14911 ts_tablet_manager.cc:1939] T 124fd859e6464abe94eb1a492726ad60 P 6268661f91b64c33a5468d4ab1c42b44: Deleting consensus metadata
I20260809 06:33:02.472592 14117 catalog_manager.cc:4841] TS 6268661f91b64c33a5468d4ab1c42b44 (127.30.78.65:37851): tablet 124fd859e6464abe94eb1a492726ad60 (table test-table [id=8e48f69ad7ca4d4eb727fe8a7b2af719]) successfully deleted
I20260809 06:33:02.474165 14913 tablet_replica.cc:330] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: stopping tablet replica
I20260809 06:33:02.474619 14913 raft_consensus.cc:2229] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:33:02.475281 14913 raft_consensus.cc:2258] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:33:02.477507 14913 ts_tablet_manager.cc:1905] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 06:33:02 dist-test-slave-cvwc krb5kdc[14074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:33:02.483975 14913 ts_tablet_manager.cc:1918] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:33:02.484164 14913 log.cc:1196] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/124fd859e6464abe94eb1a492726ad60
I20260809 06:33:02.484720 14913 ts_tablet_manager.cc:1939] T 124fd859e6464abe94eb1a492726ad60 P 8265e5776eea4b64b65a418e0af543dc: Deleting consensus metadata
I20260809 06:33:02.486534 14122 catalog_manager.cc:4841] TS 8265e5776eea4b64b65a418e0af543dc (127.30.78.67:41023): tablet 124fd859e6464abe94eb1a492726ad60 (table test-table [id=8e48f69ad7ca4d4eb727fe8a7b2af719]) successfully deleted
I20260809 06:33:02.489503 14866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.456526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34122 (local address 127.30.78.65:37851)
0809 06:33:02.456684 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.456690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.472065 (+ 15375us) server_negotiation.cc:407] Connection header received
0809 06:33:02.472256 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.472261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.472348 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.472468 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:02.474511 (+ 2043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.475524 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.477229 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.477899 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.478031 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.483108 (+ 5077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:02.483123 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:02.483141 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:02.483185 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:02.486897 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.487665 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.487671 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.487674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.487790 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.488172 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.488175 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.488177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.488521 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:02.488738 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.489078 (+ 340us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.489236 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:33:02.490317 14424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:33:02.578086 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 14234
I20260809 06:33:02.611079 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 14440
Aug 09 06:33:02 dist-test-slave-cvwc krb5kdc[14074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:33:02.627743 14870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.611916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36132 (local address 127.30.78.66:46249)
0809 06:33:02.612095 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.612101 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.612230 (+ 129us) server_negotiation.cc:407] Connection header received
0809 06:33:02.612422 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.612427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.612510 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.612613 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:02.614260 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.615366 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.617133 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.617510 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.617606 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.622412 (+ 4806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:02.622425 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:02.622440 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:02.622477 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:02.625115 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.625759 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.625768 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.625771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.625895 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.626259 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.626263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.626265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.626637 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:02.626924 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.627218 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.627437 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:33:02.628369 14639 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:33:02.716051 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 14440
I20260809 06:33:02.737548 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 14653
Aug 09 06:33:02 dist-test-slave-cvwc krb5kdc[14074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:33:02.753226 14872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:02.738349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47094 (local address 127.30.78.67:41023)
0809 06:33:02.738572 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:02.738577 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:02.738600 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:33:02.738726 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:02.738731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:02.738807 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:02.738905 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:02.740153 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.741007 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.742515 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:02.742989 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:02.743097 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:02.747127 (+ 4030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:02.747140 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:02.747155 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:02.747197 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:02.750395 (+ 3198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.751045 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.751053 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.751055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.751216 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:02.751588 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:02.751591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:02.751594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:02.751982 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:02.752307 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:02.752601 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 06:33:02.752832 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 06:33:02.753993 14839 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:33:02.878021 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 14653
I20260809 06:33:02.903411 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 14091
I20260809 06:33:02.904547 14192 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:33:03.010187 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 14091
2026-08-09T06:33:03Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4298 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:33:03 dist-test-slave-cvwc krb5kdc[14924](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:33:03 dist-test-slave-cvwc krb5kdc[14924](info): set up 2 sockets
Aug 09 06:33:03 dist-test-slave-cvwc krb5kdc[14924](info): commencing operation
krb5kdc: starting...
W20260809 06:33:04.219501 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:33:04 dist-test-slave-cvwc krb5kdc[14924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:33:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:33:04Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.78.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.78.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/rangeradmin_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/rangeradmin_127.30.78.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.78.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.78.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/rangerlookup_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/rangerlookup_127.30.78.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.78.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.78.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/HTTP_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/HTTP_127.30.78.84@KRBTEST.COM.keytab.
I20260809 06:33:04.548681 31033 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasklYlngI/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/postgres -l logfile start
2026-08-09 06:33:06.886 UTC [14966] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 06:33:06.886 UTC [14966] LOG: listening on IPv4 address "127.30.78.84", port 56051
2026-08-09 06:33:06.889 UTC [14966] LOG: listening on Unix socket "/tmp/.s.PGSQL.56051"
2026-08-09 06:33:06.910 UTC [14974] LOG: database system was shut down at 2026-08-09 06:33:05 UTC
2026-08-09 06:33:06.913 UTC [14966] LOG: database system is ready to accept connections
I20260809 06:33:07.981534 31033 mini_postgres.cc:96] Postgres bound to 56051
2026-08-09 06:33:08.003 UTC [14983] FATAL: database "slave" does not exist
127.30.78.84:56051 - accepting connections
I20260809 06:33:08.004546 31033 mini_ranger.cc:161] Starting Ranger...
I20260809 06:33:08.031152 31033 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 06:33:08.457465 31033 mini_ranger.cc:87] Created ranger Postgres database
I20260809 06:33:08.457589 31033 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-admin
2026-08-09 06:33:08,787 [I] DB FLAVOR :POSTGRES
2026-08-09 06:33:08,787 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 06:33:08,788 [I] Checking connection..
2026-08-09 06:33:08,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 06:33:09,045 [I] Checking connection passed.
2026-08-09 06:33:09,045 [I] --------- Verifying version history table ---------
2026-08-09 06:33:09,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:33:09,293 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 06:33:09,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:33:09,555 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 06:33:09,555 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 06:33:09,555 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 06:33:09.803 UTC [15075] WARNING: there is no transaction in progress
2026-08-09 06:33:09,811 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 06:33:09,812 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:33:10,056 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 06:33:10,056 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 06:33:10,057 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 06:33:10,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 06:33:10,541 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-cvwc.c.gcp-upstream.internal','N') ;"
2026-08-09 06:33:10,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 06:33:11,060 [I] Table x_portal_user does not exist in database ranger
2026-08-09 06:33:11,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 06:33:11,296 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 06:33:11,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 06:33:11,540 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 06:33:11,781 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 06:33:11,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 06:33:12.641 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.656 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.670 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.684 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.701 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.720 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.771 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.777 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.789 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.798 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.807 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.820 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.828 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.833 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.839 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:12.845 UTC [15241] WARNING: there is no transaction in progress
2026-08-09 06:33:13,392 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 06:33:13,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 06:33:13,611 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 06:33:13,612 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 06:33:13,864 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 06:33:13,864 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 06:33:14,091 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 06:33:14,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 06:33:14,331 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 06:33:14,576 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-cvwc.c.gcp-upstream.internal';"
2026-08-09 06:33:14,802 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 06:33:14,803 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 06:33:15,058 [I] DB_PATCHES have already been applied
I20260809 06:33:15.063679 31033 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-admin:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasklYlngI/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 06:33:15.063763 31033 mini_ranger.cc:193] Using host: 127.30.78.84
I20260809 06:33:15.081694 31033 mini_ranger.cc:227] Ranger admin URL: http://127.30.78.84:56707
Aug 09, 2026 6:33:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:33:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:33:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:33:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:33:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:33:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:33:16 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 06:33:16.332731 31033 mini_ranger.cc:160] Time spent starting Ranger: real 8.328s user 0.003s sys 0.047s
Aug 09, 2026 6:33:35 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:33:35 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Aug 09, 2026 6:33:35 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:33:35 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:33:36 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 06:33:37.330528 31033 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.78.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.78.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/rangerkms_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/rangerkms_127.30.78.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.78.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.78.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.78.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/HTTP_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.78.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/HTTP_127.30.78.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 06:33:37 dist-test-slave-cvwc krb5kdc[14924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257217, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 06:33:37.501333 31033 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 06:33:37.522179 31033 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 06:33:38.241137 31033 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 06:33:38.241297 31033 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-kms
I20260809 06:33:38.241405 31033 mini_ranger_kms.cc:227] Using postgres at 127.30.78.84:56051
2026-08-09 06:33:38,728 [I] DB FLAVOR :POSTGRES
2026-08-09 06:33:38,728 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 06:33:38,728 [I] Checking connection
2026-08-09 06:33:38,728 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 06:33:38,966 [I] connection success
2026-08-09 06:33:38,967 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 06:33:38,967 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 06:33:38,967 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 06:33:39,222 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 06:33:39,222 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 06:33:39,222 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 06:33:39,222 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:56051/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 06:33:39,466 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 06:33:39.941094 31033 mini_ranger_kms.cc:310] Created kms service
I20260809 06:33:40.129964 31033 mini_ranger_kms.cc:326] Created kudu user
I20260809 06:33:40.169461 31033 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 06:33:40 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257217, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:33:40.595104 31033 mini_ranger_kms.cc:384] Added ranger policy
I20260809 06:33:40.596405 31033 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-kms:/tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 06:33:40.596462 31033 mini_ranger_kms.cc:240] Using host: 127.30.78.84
I20260809 06:33:40.618629 31033 mini_ranger_kms.cc:276] Ranger KMS PID: 15507
I20260809 06:33:40.618804 31033 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.78.84:53831
Aug 09, 2026 6:33:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:33:41 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:33:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:33:41 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:33:42 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:33:42 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 06:33:42 dist-test-slave-cvwc krb5kdc[14924](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786257222, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.78.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:33:43.133891 31033 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.633s user 0.159s sys 0.356s
I20260809 06:33:43.134233 31033 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 06:33:43.134447 31033 mini_ranger_kms.cc:401] 127.30.78.84:53831/kms/v1/keys
Aug 09 06:33:43 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257222, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.78.84@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
Aug 09 06:33:43 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257222, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.78.84@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
Aug 09 06:33:45 dist-test-slave-cvwc krb5kdc[14924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:33:45.975170 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:35071
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:35071
--ranger_config_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:53831/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:33:46.306191 15590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:33:46.306478 15590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:33:46.306619 15590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:33:46.313599 15590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:33:46.313726 15590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:33:46.313807 15590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:33:46.313891 15590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:33:46.313958 15590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:33:46.323616 15590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.78.84:53831/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:35071
--ranger_config_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:35071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:33:46.324743 15590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:33:46.325987 15590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:33:46.337306 15596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:46.337353 15597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:46.337260 15600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:33:46.338163 15590 server_base.cc:1034] running on GCE node
I20260809 06:33:46.338897 15590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:33:46.340129 15590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:33:46.341331 15590 hybrid_clock.cc:648] HybridClock initialized: now 1786257226341280 us; error 33 us; skew 500 ppm
I20260809 06:33:46.341643 15590 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:33:46 dist-test-slave-cvwc krb5kdc[14924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257226, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:33:46.348546 15590 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:33:46.349951 15590 webserver.cc:460] Webserver started at http://127.30.78.126:33629/ using document root <none> and password file <none>
I20260809 06:33:46.350523 15590 fs_manager.cc:359] Metadata directory not provided
I20260809 06:33:46.350633 15590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:33:46.350909 15590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:33:46 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257226, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:33:46.406333 15590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "d8b0841bf26d476dbd2f002d13fd6ebf"
format_stamp: "Formatted at 2026-08-09 06:33:46 on dist-test-slave-cvwc"
server_key: "4f1e273c87e3e713a6a3748b1456c9da"
server_key_iv: "dac3959644fcc62253c7729a2905eee8"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:46.407150 15590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "d8b0841bf26d476dbd2f002d13fd6ebf"
format_stamp: "Formatted at 2026-08-09 06:33:46 on dist-test-slave-cvwc"
server_key: "4f1e273c87e3e713a6a3748b1456c9da"
server_key_iv: "dac3959644fcc62253c7729a2905eee8"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:46.413012 15590 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 06:33:46.429849 15612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:46.431315 15590 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:33:46.431497 15590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "d8b0841bf26d476dbd2f002d13fd6ebf"
format_stamp: "Formatted at 2026-08-09 06:33:46 on dist-test-slave-cvwc"
server_key: "4f1e273c87e3e713a6a3748b1456c9da"
server_key_iv: "dac3959644fcc62253c7729a2905eee8"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:46.431692 15590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:33:46.460628 15590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:33:46.464432 15590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:33:46.464706 15590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:33:46.481935 15590 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:35071
I20260809 06:33:46.481958 15684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:35071 every 8 connection(s)
I20260809 06:33:46.483212 15590 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:33:46.484925 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 15590
I20260809 06:33:46.485121 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:33:46.485931 31033 external_mini_cluster.cc:1428] Setting key 65340d16adc9cd398c895ea13e7ce3f0
I20260809 06:33:46.487584 15685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:33:46 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:33:46.500629 15685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf: Bootstrap starting.
I20260809 06:33:46.503804 15685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf: Neither blocks nor log segments found. Creating new log.
I20260809 06:33:46.504741 15685 log.cc:824] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf: Log is configured to *not* fsync() on all Append() calls
I20260809 06:33:46.507458 15690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:46.488434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39900 (local address 127.30.78.126:35071)
0809 06:33:46.489235 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:46.489250 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:46.489298 (+ 48us) server_negotiation.cc:407] Connection header received
0809 06:33:46.491020 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:46.491050 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:46.491537 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:46.491974 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:46.493032 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:46.495108 (+ 2076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:46.496256 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:46.497225 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:46.497426 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:46.500930 (+ 3504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:46.500938 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:46.500951 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:46.500985 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:46.503767 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:46.504377 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:46.504385 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:46.504391 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:46.504544 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:46.504914 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:46.504918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:46.504920 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:46.505420 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:46.505744 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:46.506166 (+ 422us) server_negotiation.cc:299] Negotiation successful
0809 06:33:46.506518 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":352,"threads_started":1}
I20260809 06:33:46.507438 15685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf: No bootstrap required, opened a new log
I20260809 06:33:46.514864 15685 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b0841bf26d476dbd2f002d13fd6ebf" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35071 } }
I20260809 06:33:46.515192 15685 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:33:46.515285 15685 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8b0841bf26d476dbd2f002d13fd6ebf, State: Initialized, Role: FOLLOWER
I20260809 06:33:46.515856 15685 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b0841bf26d476dbd2f002d13fd6ebf" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35071 } }
I20260809 06:33:46.516121 15685 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:33:46.516243 15685 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:33:46.516402 15685 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:33:46.518389 15685 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b0841bf26d476dbd2f002d13fd6ebf" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35071 } }
I20260809 06:33:46.518824 15685 leader_election.cc:302] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8b0841bf26d476dbd2f002d13fd6ebf; no voters:
I20260809 06:33:46.519335 15685 leader_election.cc:288] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:33:46.519447 15692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:33:46.520080 15692 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [term 1 LEADER]: Becoming Leader. State: Replica: d8b0841bf26d476dbd2f002d13fd6ebf, State: Running, Role: LEADER
I20260809 06:33:46.520572 15692 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b0841bf26d476dbd2f002d13fd6ebf" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35071 } }
I20260809 06:33:46.521121 15685 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:33:46.523097 15694 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8b0841bf26d476dbd2f002d13fd6ebf. Latest consensus state: current_term: 1 leader_uuid: "d8b0841bf26d476dbd2f002d13fd6ebf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b0841bf26d476dbd2f002d13fd6ebf" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35071 } } }
I20260809 06:33:46.523535 15694 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [sys.catalog]: This master's current role is: LEADER
I20260809 06:33:46.523336 15693 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8b0841bf26d476dbd2f002d13fd6ebf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8b0841bf26d476dbd2f002d13fd6ebf" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35071 } } }
I20260809 06:33:46.523998 15693 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf [sys.catalog]: This master's current role is: LEADER
I20260809 06:33:46.525888 15704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:33:46.530623 15704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:33:46.531392 15685 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 06:33:46.549211 15704 catalog_manager.cc:1347] Generated new cluster ID: c935949351e647789b4d75fb8512d60f
I20260809 06:33:46.549342 15704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:33:46.566617 15704 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:33:46.568573 15704 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:33:46.584264 15704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf: Generated new TSK 0
I20260809 06:33:46.585405 15704 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:33:47.292899 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:53831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35071
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:33:47 dist-test-slave-cvwc krb5kdc[14924](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786257227, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 06:33:47.725102 15759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:33:47.725443 15759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:33:47.725633 15759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:33:47.736922 15759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:33:47.737054 15759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:33:47.737255 15759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:33:47.752749 15759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.78.84:53831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:33:47.754640 15759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:33:47.756378 15759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:33:47.774138 15773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:47.774603 15775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:33:47.781873 15759 server_base.cc:1034] running on GCE node
W20260809 06:33:47.782516 15779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:33:47.783340 15759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:33:47.784611 15759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:33:47.785878 15759 hybrid_clock.cc:648] HybridClock initialized: now 1786257227785809 us; error 66 us; skew 500 ppm
I20260809 06:33:47.786206 15759 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:33:47 dist-test-slave-cvwc krb5kdc[14924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257227, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:33:47.789516 15759 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:33:47.797875 15759 webserver.cc:460] Webserver started at http://127.30.78.65:34473/ using document root <none> and password file <none>
I20260809 06:33:47.798609 15759 fs_manager.cc:359] Metadata directory not provided
I20260809 06:33:47.798728 15759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:33:47.799038 15759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:33:47 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257227, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:33:47.831961 15759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "7445e78ef5924e76b743a08fcf43acfe"
format_stamp: "Formatted at 2026-08-09 06:33:47 on dist-test-slave-cvwc"
server_key: "43f8363948296013ad64b1d464602848"
server_key_iv: "464ee817fd81c815e1139fab21be7526"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:47.833066 15759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "7445e78ef5924e76b743a08fcf43acfe"
format_stamp: "Formatted at 2026-08-09 06:33:47 on dist-test-slave-cvwc"
server_key: "43f8363948296013ad64b1d464602848"
server_key_iv: "464ee817fd81c815e1139fab21be7526"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:47.847836 15759 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.009s sys 0.007s
I20260809 06:33:47.878301 15788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:47.882529 15759 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.004s sys 0.010s
I20260809 06:33:47.882838 15759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "7445e78ef5924e76b743a08fcf43acfe"
format_stamp: "Formatted at 2026-08-09 06:33:47 on dist-test-slave-cvwc"
server_key: "43f8363948296013ad64b1d464602848"
server_key_iv: "464ee817fd81c815e1139fab21be7526"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:47.883209 15759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:33:47.928066 15759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:33:47.931937 15759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:33:47.932256 15759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:33:47.933249 15759 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:33:47.934829 15759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:33:47.934930 15759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:47.935056 15759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:33:47.935173 15759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
Aug 09 06:33:47 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257227, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:33:48.171208 15759 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:38923
I20260809 06:33:48.171247 15951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:38923 every 8 connection(s)
I20260809 06:33:48.172747 15759 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:33:48.176005 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 15759
I20260809 06:33:48.176203 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:33:48.176847 31033 external_mini_cluster.cc:1428] Setting key 69d21c1362034a39874e9bfe4e4a0262
Aug 09 06:33:48 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257227, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:33:48.203781 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:48.176371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:35071 (local address 127.30.78.65:49185)
0809 06:33:48.178664 (+ 2293us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:48.178714 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:48.184142 (+ 5428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:48.185211 (+ 1069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:48.185223 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:48.185862 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:33:48.186700 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:48.186723 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:48.188248 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:48.188253 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:48.190454 (+ 2201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:48.190470 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:48.191515 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:48.191522 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:48.191834 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:48.192588 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:33:48.192622 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:33:48.195250 (+ 2628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:33:48.199271 (+ 4021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:48.199279 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:48.199294 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:48.199852 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:48.200292 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:48.200296 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:48.200300 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:48.200542 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:48.201207 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:33:48.201216 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:33:48.201620 (+ 404us) client_negotiation.cc:769] Sending connection context
0809 06:33:48.201937 (+ 317us) client_negotiation.cc:240] Negotiation successful
0809 06:33:48.202434 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1997,"thread_start_us":1761,"threads_started":1}
I20260809 06:33:48.205869 15956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:48.176907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:49185 (local address 127.30.78.126:35071)
0809 06:33:48.178099 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:48.178105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:48.184508 (+ 6403us) server_negotiation.cc:407] Connection header received
0809 06:33:48.184577 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:48.184583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:48.184675 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:48.184784 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:48.186916 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:48.188067 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:48.190609 (+ 2542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:48.191267 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:48.191398 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:48.195516 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:48.195524 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:48.195529 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:48.195568 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:48.199135 (+ 3567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:48.199997 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:48.200003 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:48.200006 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:48.200166 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:48.200687 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:48.200693 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:48.200696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:48.201075 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:48.201236 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:48.205205 (+ 3969us) server_negotiation.cc:299] Negotiation successful
0809 06:33:48.205425 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1077,"thread_start_us":936,"threads_started":1}
I20260809 06:33:48.207891 15953 heartbeater.cc:347] Connected to a master server at 127.30.78.126:35071
I20260809 06:33:48.208199 15953 heartbeater.cc:464] Registering TS with master...
I20260809 06:33:48.208974 15953 heartbeater.cc:511] Master 127.30.78.126:35071 requested a full tablet report, sending...
I20260809 06:33:48.211552 15634 ts_manager.cc:194] Registered new tserver with Master: 7445e78ef5924e76b743a08fcf43acfe (127.30.78.65:38923)
I20260809 06:33:48.213610 15634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:49185
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:33:48.257092 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:53831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35071
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:33:48 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257227, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
W20260809 06:33:48.718056 15960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:33:48.718333 15960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:33:48.718513 15960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:33:48.725816 15960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:33:48.725927 15960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:33:48.726100 15960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:33:48.735743 15960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.78.84:53831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:33:48.737267 15960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:33:48.738574 15960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:33:48.754941 15979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:48.755656 15981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:48.756906 15984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:33:48.758025 15960 server_base.cc:1034] running on GCE node
I20260809 06:33:48.758641 15960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:33:48.759613 15960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:33:48.760891 15960 hybrid_clock.cc:648] HybridClock initialized: now 1786257228760819 us; error 63 us; skew 500 ppm
I20260809 06:33:48.761217 15960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:33:48 dist-test-slave-cvwc krb5kdc[14924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257228, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:33:48.764381 15960 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:33:48.766165 15960 webserver.cc:460] Webserver started at http://127.30.78.66:42401/ using document root <none> and password file <none>
I20260809 06:33:48.766873 15960 fs_manager.cc:359] Metadata directory not provided
I20260809 06:33:48.767009 15960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:33:48.767325 15960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:33:48 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257228, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:33:48.791857 15960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "3268323e24cf433fb009ce414e2acb39"
format_stamp: "Formatted at 2026-08-09 06:33:48 on dist-test-slave-cvwc"
server_key: "340879b42c22e32778227ffef7f54cb0"
server_key_iv: "7366bb6fa373a968e650c98f718b768c"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:48.792713 15960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "3268323e24cf433fb009ce414e2acb39"
format_stamp: "Formatted at 2026-08-09 06:33:48 on dist-test-slave-cvwc"
server_key: "340879b42c22e32778227ffef7f54cb0"
server_key_iv: "7366bb6fa373a968e650c98f718b768c"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:48.798925 15960 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260809 06:33:48.819069 15993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:48.820600 15960 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.001s
I20260809 06:33:48.820780 15960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "3268323e24cf433fb009ce414e2acb39"
format_stamp: "Formatted at 2026-08-09 06:33:48 on dist-test-slave-cvwc"
server_key: "340879b42c22e32778227ffef7f54cb0"
server_key_iv: "7366bb6fa373a968e650c98f718b768c"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:48.821019 15960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:33:48.853525 15960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:33:48.858807 15960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:33:48.859138 15960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:33:48.862138 15960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:33:48.863950 15960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:33:48.864050 15960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:48.864174 15960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:33:48.864238 15960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:48.905774 15960 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:40509
I20260809 06:33:48.905818 16162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:40509 every 8 connection(s)
I20260809 06:33:48.907446 15960 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:33:48.913084 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 15960
I20260809 06:33:48.913247 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:33:48.913769 31033 external_mini_cluster.cc:1428] Setting key 1e22539e0608c90d520855d4dddf669a
Aug 09 06:33:48 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257228, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:33:48.933979 16166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:48.910280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:46075 (local address 127.30.78.126:35071)
0809 06:33:48.910754 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:48.910761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:48.911993 (+ 1232us) server_negotiation.cc:407] Connection header received
0809 06:33:48.914747 (+ 2754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:48.914754 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:48.914844 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:48.914954 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:48.917472 (+ 2518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:48.918689 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:48.920983 (+ 2294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:48.921635 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:48.921752 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:48.926723 (+ 4971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:48.926729 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:48.926734 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:48.926775 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:48.930095 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:48.931033 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:48.931040 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:48.931043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:48.931205 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:48.931776 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:48.931781 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:48.931784 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:48.932134 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:48.932291 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:48.933319 (+ 1028us) server_negotiation.cc:299] Negotiation successful
0809 06:33:48.933559 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":242,"threads_started":1}
I20260809 06:33:48.936261 16167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:48.910934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:35071 (local address 127.30.78.66:46075)
0809 06:33:48.911816 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:48.911867 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:48.914407 (+ 2540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:48.915379 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:48.915390 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:48.916327 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:33:48.917225 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:48.917254 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:48.918910 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:48.918916 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:48.920820 (+ 1904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:48.920835 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:48.922132 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:48.922139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:48.922405 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:48.923129 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:33:48.923157 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:33:48.926398 (+ 3241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:33:48.930262 (+ 3864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:48.930272 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:48.930301 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:48.930889 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:48.931377 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:48.931381 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:48.931385 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:48.931643 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:48.932437 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:33:48.932446 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:33:48.932847 (+ 401us) client_negotiation.cc:769] Sending connection context
0809 06:33:48.934295 (+ 1448us) client_negotiation.cc:240] Negotiation successful
0809 06:33:48.934826 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":354,"threads_started":1}
I20260809 06:33:48.938097 16163 heartbeater.cc:347] Connected to a master server at 127.30.78.126:35071
I20260809 06:33:48.938439 16163 heartbeater.cc:464] Registering TS with master...
I20260809 06:33:48.939334 16163 heartbeater.cc:511] Master 127.30.78.126:35071 requested a full tablet report, sending...
I20260809 06:33:48.940960 15634 ts_manager.cc:194] Registered new tserver with Master: 3268323e24cf433fb009ce414e2acb39 (127.30.78.66:40509)
I20260809 06:33:48.942051 15634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:46075
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:33:48.988907 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:53831/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35071
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:33:49.217442 15953 heartbeater.cc:503] Master 127.30.78.126:35071 was elected leader, sending a full tablet report...
W20260809 06:33:49.351881 16171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:33:49.352239 16171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:33:49.352396 16171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:33:49.359557 16171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:33:49.359664 16171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:33:49.359812 16171 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:33:49.369606 16171 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.78.84:53831/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:33:49.370882 16171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:33:49.372196 16171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:33:49.384752 16177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:49.384675 16180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:33:49.384716 16178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:33:49.385499 16171 server_base.cc:1034] running on GCE node
I20260809 06:33:49.386106 16171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:33:49.386976 16171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:33:49.388185 16171 hybrid_clock.cc:648] HybridClock initialized: now 1786257229388134 us; error 42 us; skew 500 ppm
I20260809 06:33:49.388499 16171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:33:49 dist-test-slave-cvwc krb5kdc[14924](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257229, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:33:49.391498 16171 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:33:49.392764 16171 webserver.cc:460] Webserver started at http://127.30.78.67:39209/ using document root <none> and password file <none>
I20260809 06:33:49.393358 16171 fs_manager.cc:359] Metadata directory not provided
I20260809 06:33:49.393455 16171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:33:49.393699 16171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:33:49 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257229, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:33:49.410498 16171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab"
format_stamp: "Formatted at 2026-08-09 06:33:49 on dist-test-slave-cvwc"
server_key: "5fc3e8c0944b423b60c20b62d5878abd"
server_key_iv: "d9ac321676f70ff5b8c1d5e343fbef23"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:49.411558 16171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab"
format_stamp: "Formatted at 2026-08-09 06:33:49 on dist-test-slave-cvwc"
server_key: "5fc3e8c0944b423b60c20b62d5878abd"
server_key_iv: "d9ac321676f70ff5b8c1d5e343fbef23"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:49.418011 16171 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260809 06:33:49.432935 16189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:49.434377 16171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:33:49.434546 16171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab"
format_stamp: "Formatted at 2026-08-09 06:33:49 on dist-test-slave-cvwc"
server_key: "5fc3e8c0944b423b60c20b62d5878abd"
server_key_iv: "d9ac321676f70ff5b8c1d5e343fbef23"
server_key_version: "kuduclusterkey@0"
I20260809 06:33:49.434729 16171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:33:49.455226 16171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:33:49.458938 16171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:33:49.459210 16171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:33:49.460108 16171 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:33:49.461405 16171 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:33:49.461476 16171 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:49.461642 16171 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:33:49.461699 16171 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:33:49.492439 16171 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:32923
I20260809 06:33:49.492479 16365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:32923 every 8 connection(s)
I20260809 06:33:49.493635 16171 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:33:49.500288 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 16171
I20260809 06:33:49.500468 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:33:49.501004 31033 external_mini_cluster.cc:1428] Setting key 75e9c2eabe6168114ae82148ffada097
Aug 09 06:33:49 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257229, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:33:49.512991 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.496019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:60295 (local address 127.30.78.126:35071)
0809 06:33:49.496667 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.496673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.497671 (+ 998us) server_negotiation.cc:407] Connection header received
0809 06:33:49.499923 (+ 2252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.499927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.500009 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.500099 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:49.501877 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.502717 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.504576 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.505010 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.505104 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.508200 (+ 3096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:49.508205 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:49.508208 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:49.508248 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:49.510630 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:49.511247 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:49.511251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:49.511253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:49.511369 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:49.511719 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:49.511721 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:49.511723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:49.511967 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:49.512071 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.512580 (+ 509us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.512741 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":271,"threads_started":1}
I20260809 06:33:49.513860 16370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.496629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:35071 (local address 127.30.78.67:60295)
0809 06:33:49.497512 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:49.497561 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:49.499681 (+ 2120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:49.500363 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:49.500385 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:49.500946 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:33:49.501701 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.501747 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.502865 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.502879 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.504451 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.504464 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.505177 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.505181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.505370 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.505959 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:33:49.505984 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:33:49.508005 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:33:49.510751 (+ 2746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:49.510757 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:49.510768 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:49.511159 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:49.511454 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:33:49.511457 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:33:49.511459 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:33:49.511639 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:33:49.512051 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:33:49.512056 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:33:49.512313 (+ 257us) client_negotiation.cc:769] Sending connection context
0809 06:33:49.512518 (+ 205us) client_negotiation.cc:240] Negotiation successful
0809 06:33:49.512839 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":354,"threads_started":1}
I20260809 06:33:49.515192 16366 heartbeater.cc:347] Connected to a master server at 127.30.78.126:35071
I20260809 06:33:49.515486 16366 heartbeater.cc:464] Registering TS with master...
I20260809 06:33:49.516201 16366 heartbeater.cc:511] Master 127.30.78.126:35071 requested a full tablet report, sending...
I20260809 06:33:49.517447 15634 ts_manager.cc:194] Registered new tserver with Master: e4fba0628c7943d5b26f5bbe3e1d7fab (127.30.78.67:32923)
I20260809 06:33:49.518241 15634 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:60295
I20260809 06:33:49.527937 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:33:49.545420 16368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.532440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39906 (local address 127.30.78.126:35071)
0809 06:33:49.532596 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.532602 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.533104 (+ 502us) server_negotiation.cc:407] Connection header received
0809 06:33:49.533308 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.533314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.533391 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.533482 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:49.535382 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.536142 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.537473 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.537924 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.538034 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.540420 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:49.540425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:49.540428 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:49.540457 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:49.542775 (+ 2318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:49.543533 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:49.543539 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:49.543543 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:49.543671 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:49.544061 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:49.544065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:49.544067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:49.544346 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:49.544582 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.544905 (+ 323us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.545125 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 06:33:49.549114 15634 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:33:49.556000 15634 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:33:49.592728 16393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.568390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59296 (local address 127.30.78.65:38923)
0809 06:33:49.581966 (+ 13576us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.581976 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.582010 (+ 34us) server_negotiation.cc:407] Connection header received
0809 06:33:49.582118 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.582126 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.582396 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.582862 (+ 466us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:49.585342 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.586990 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.589775 (+ 2785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.591218 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.591332 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.591563 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.592222 (+ 659us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.592395 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13364,"thread_start_us":14042,"threads_started":1}
I20260809 06:33:49.592796 16390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.567923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38923 (local address 127.0.0.1:59296)
0809 06:33:49.579478 (+ 11555us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:49.579521 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:49.579703 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:49.584181 (+ 4478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:49.584192 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:49.584222 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:49.585153 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.585168 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.587119 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.587123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.589566 (+ 2443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.589581 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.591738 (+ 2157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.591744 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.591952 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.592021 (+ 69us) client_negotiation.cc:769] Sending connection context
0809 06:33:49.592153 (+ 132us) client_negotiation.cc:240] Negotiation successful
0809 06:33:49.592325 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11255,"mutex_wait_us":25,"thread_start_us":11950,"threads_started":1}
I20260809 06:33:49.593291 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.583931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:32923 (local address 127.0.0.1:59958)
0809 06:33:49.584923 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:49.584935 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:49.585036 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:49.585553 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:49.585556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:49.585576 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:49.585889 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.585898 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.587657 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.587662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.589906 (+ 2244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.589921 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.592040 (+ 2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.592046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.592216 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.592246 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:33:49.592310 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 06:33:49.592417 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"mutex_wait_us":27,"thread_start_us":541,"threads_started":1}
I20260809 06:33:49.593375 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.581114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59958 (local address 127.30.78.67:32923)
0809 06:33:49.583937 (+ 2823us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.583944 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.585019 (+ 1075us) server_negotiation.cc:407] Connection header received
0809 06:33:49.585164 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.585169 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.585363 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.585548 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:49.586058 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.587507 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.590082 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.591543 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.591643 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.591854 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.592864 (+ 1010us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.593029 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2666,"thread_start_us":2489,"threads_started":1}
I20260809 06:33:49.593773 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.567923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:40509 (local address 127.0.0.1:43580)
0809 06:33:49.584274 (+ 16351us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:49.584510 (+ 236us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:49.584698 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:49.587157 (+ 2459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:49.587165 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:49.587190 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:49.587645 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.587658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.589375 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.589380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.591334 (+ 1954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.591347 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.592984 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.592990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.593151 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.593181 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:33:49.593260 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 06:33:49.593394 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16211,"mutex_wait_us":160,"thread_start_us":15612,"threads_started":1}
I20260809 06:33:49.594383 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.568018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43580 (local address 127.30.78.66:40509)
0809 06:33:49.583532 (+ 15514us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.583542 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.584611 (+ 1069us) server_negotiation.cc:407] Connection header received
0809 06:33:49.584883 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.584891 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.585134 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.585319 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:49.587845 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.589245 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.591481 (+ 2236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.592523 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.592648 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.592827 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.593862 (+ 1035us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.594030 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15323,"thread_start_us":15209,"threads_started":1}
I20260809 06:33:49.597325 16063 tablet_service.cc:1467] Processing CreateTablet for tablet 8ae31d751f674cbfab29fedccee8e1d1 (DEFAULT_TABLE table=test-table [id=48f93bca49834091b3e7adbded0600fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:33:49.597330 15858 tablet_service.cc:1467] Processing CreateTablet for tablet 8ae31d751f674cbfab29fedccee8e1d1 (DEFAULT_TABLE table=test-table [id=48f93bca49834091b3e7adbded0600fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:33:49.597330 16264 tablet_service.cc:1467] Processing CreateTablet for tablet 8ae31d751f674cbfab29fedccee8e1d1 (DEFAULT_TABLE table=test-table [id=48f93bca49834091b3e7adbded0600fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:33:49.598683 16063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ae31d751f674cbfab29fedccee8e1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:33:49.598829 15858 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ae31d751f674cbfab29fedccee8e1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:33:49.598829 16264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ae31d751f674cbfab29fedccee8e1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:33:49.609115 16396 tablet_bootstrap.cc:492] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: Bootstrap starting.
I20260809 06:33:49.612416 16396 tablet_bootstrap.cc:654] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: Neither blocks nor log segments found. Creating new log.
I20260809 06:33:49.612475 16397 tablet_bootstrap.cc:492] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: Bootstrap starting.
I20260809 06:33:49.613222 16398 tablet_bootstrap.cc:492] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: Bootstrap starting.
I20260809 06:33:49.613829 16396 log.cc:824] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: Log is configured to *not* fsync() on all Append() calls
I20260809 06:33:49.616446 16398 tablet_bootstrap.cc:654] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: Neither blocks nor log segments found. Creating new log.
I20260809 06:33:49.616598 16397 tablet_bootstrap.cc:654] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: Neither blocks nor log segments found. Creating new log.
I20260809 06:33:49.617553 16396 tablet_bootstrap.cc:492] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: No bootstrap required, opened a new log
I20260809 06:33:49.617579 16397 log.cc:824] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: Log is configured to *not* fsync() on all Append() calls
I20260809 06:33:49.617753 16398 log.cc:824] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: Log is configured to *not* fsync() on all Append() calls
I20260809 06:33:49.617858 16396 ts_tablet_manager.cc:1397] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260809 06:33:49.620172 16398 tablet_bootstrap.cc:492] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: No bootstrap required, opened a new log
I20260809 06:33:49.620402 16398 ts_tablet_manager.cc:1397] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260809 06:33:49.620445 16397 tablet_bootstrap.cc:492] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: No bootstrap required, opened a new log
I20260809 06:33:49.620685 16397 ts_tablet_manager.cc:1397] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 06:33:49.627388 16398 raft_consensus.cc:348] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } }
I20260809 06:33:49.627705 16398 raft_consensus.cc:374] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:33:49.627808 16398 raft_consensus.cc:729] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7445e78ef5924e76b743a08fcf43acfe, State: Initialized, Role: FOLLOWER
I20260809 06:33:49.627753 16396 raft_consensus.cc:348] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } }
I20260809 06:33:49.628166 16396 raft_consensus.cc:374] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:33:49.628261 16396 raft_consensus.cc:729] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3268323e24cf433fb009ce414e2acb39, State: Initialized, Role: FOLLOWER
I20260809 06:33:49.628389 16398 consensus_queue.cc:260] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } }
I20260809 06:33:49.628823 16396 consensus_queue.cc:260] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } }
I20260809 06:33:49.631054 16398 ts_tablet_manager.cc:1428] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: Time spent starting tablet: real 0.011s user 0.006s sys 0.005s
I20260809 06:33:49.630834 16397 raft_consensus.cc:348] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } }
I20260809 06:33:49.631331 16397 raft_consensus.cc:374] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:33:49.631435 16397 raft_consensus.cc:729] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4fba0628c7943d5b26f5bbe3e1d7fab, State: Initialized, Role: FOLLOWER
I20260809 06:33:49.632133 16397 consensus_queue.cc:260] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } }
I20260809 06:33:49.633157 16366 heartbeater.cc:503] Master 127.30.78.126:35071 was elected leader, sending a full tablet report...
I20260809 06:33:49.633841 16397 ts_tablet_manager.cc:1428] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: Time spent starting tablet: real 0.013s user 0.007s sys 0.006s
I20260809 06:33:49.634701 16163 heartbeater.cc:503] Master 127.30.78.126:35071 was elected leader, sending a full tablet report...
I20260809 06:33:49.636344 16396 ts_tablet_manager.cc:1428] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: Time spent starting tablet: real 0.018s user 0.007s sys 0.010s
W20260809 06:33:49.660890 16164 tablet.cc:2369] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:33:49.671739 16403 raft_consensus.cc:482] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:33:49.672067 16403 raft_consensus.cc:504] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } }
I20260809 06:33:49.674252 16403 leader_election.cc:288] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3268323e24cf433fb009ce414e2acb39 (127.30.78.66:40509), e4fba0628c7943d5b26f5bbe3e1d7fab (127.30.78.67:32923)
W20260809 06:33:49.680292 15954 tablet.cc:2369] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:33:49.682585 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.674843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:53987 (local address 127.30.78.66:40509)
0809 06:33:49.675074 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.675080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.675180 (+ 100us) server_negotiation.cc:407] Connection header received
0809 06:33:49.675506 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.675512 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.675600 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.675699 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:49.676533 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.677667 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.680313 (+ 2646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.681446 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.681561 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.681627 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.682214 (+ 587us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.682342 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:33:49.683204 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.674429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:40509 (local address 127.30.78.65:53987)
0809 06:33:49.675081 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:49.675100 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:49.675300 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:49.675888 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:49.675894 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:49.675925 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:49.676324 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.676347 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.677895 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.677901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.680128 (+ 2227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.680144 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.681843 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.681849 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.682037 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.682069 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:33:49.682753 (+ 684us) client_negotiation.cc:240] Negotiation successful
0809 06:33:49.682892 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":320,"threads_started":1}
I20260809 06:33:49.684223 16092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae31d751f674cbfab29fedccee8e1d1" candidate_uuid: "7445e78ef5924e76b743a08fcf43acfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3268323e24cf433fb009ce414e2acb39" is_pre_election: true
I20260809 06:33:49.684722 16092 raft_consensus.cc:2454] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7445e78ef5924e76b743a08fcf43acfe in term 0.
I20260809 06:33:49.685371 15789 leader_election.cc:302] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3268323e24cf433fb009ce414e2acb39, 7445e78ef5924e76b743a08fcf43acfe; no voters:
I20260809 06:33:49.685792 16403 raft_consensus.cc:2781] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:33:49.685978 16403 raft_consensus.cc:482] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:33:49.686086 16403 raft_consensus.cc:3037] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:33:49.688671 16403 raft_consensus.cc:504] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } }
I20260809 06:33:49.689357 16403 leader_election.cc:288] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [CANDIDATE]: Term 1 election: Requested vote from peers 3268323e24cf433fb009ce414e2acb39 (127.30.78.66:40509), e4fba0628c7943d5b26f5bbe3e1d7fab (127.30.78.67:32923)
I20260809 06:33:49.689589 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.675161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:60815 (local address 127.30.78.67:32923)
0809 06:33:49.675390 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.675396 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.683584 (+ 8188us) server_negotiation.cc:407] Connection header received
0809 06:33:49.683680 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.683685 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.683770 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.683855 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:33:49.684412 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.685290 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.687502 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.688674 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.688823 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.688903 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.689211 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.689361 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:33:49.689630 16407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.674620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:32923 (local address 127.30.78.65:60815)
0809 06:33:49.683420 (+ 8800us) negotiation.cc:107] Waiting for socket to connect
0809 06:33:49.683437 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:33:49.683536 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:33:49.684036 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:33:49.684041 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:33:49.684069 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:33:49.684237 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.684247 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.685524 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.685529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.687326 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:33:49.687353 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.688837 (+ 1484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.688843 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:33:49.689041 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.689079 (+ 38us) client_negotiation.cc:769] Sending connection context
0809 06:33:49.689182 (+ 103us) client_negotiation.cc:240] Negotiation successful
0809 06:33:49.689384 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8696,"thread_start_us":10108,"threads_started":1}
I20260809 06:33:49.690807 16295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae31d751f674cbfab29fedccee8e1d1" candidate_uuid: "7445e78ef5924e76b743a08fcf43acfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab"
I20260809 06:33:49.690944 16092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae31d751f674cbfab29fedccee8e1d1" candidate_uuid: "7445e78ef5924e76b743a08fcf43acfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3268323e24cf433fb009ce414e2acb39"
I20260809 06:33:49.691154 16092 raft_consensus.cc:3037] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:33:49.691195 16295 raft_consensus.cc:3037] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:33:49.693352 16092 raft_consensus.cc:2454] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7445e78ef5924e76b743a08fcf43acfe in term 1.
I20260809 06:33:49.693801 15789 leader_election.cc:302] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3268323e24cf433fb009ce414e2acb39, 7445e78ef5924e76b743a08fcf43acfe; no voters:
I20260809 06:33:49.694092 16403 raft_consensus.cc:2781] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:33:49.693988 16296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ae31d751f674cbfab29fedccee8e1d1" candidate_uuid: "7445e78ef5924e76b743a08fcf43acfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" is_pre_election: true
I20260809 06:33:49.694607 16403 raft_consensus.cc:686] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 1 LEADER]: Becoming Leader. State: Replica: 7445e78ef5924e76b743a08fcf43acfe, State: Running, Role: LEADER
I20260809 06:33:49.695062 16403 consensus_queue.cc:237] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } }
I20260809 06:33:49.695448 16295 raft_consensus.cc:2454] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7445e78ef5924e76b743a08fcf43acfe in term 1.
I20260809 06:33:49.700641 15633 catalog_manager.cc:5495] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe reported cstate change: term changed from 0 to 1, leader changed from <none> to 7445e78ef5924e76b743a08fcf43acfe (127.30.78.65). New cstate: current_term: 1 leader_uuid: "7445e78ef5924e76b743a08fcf43acfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7445e78ef5924e76b743a08fcf43acfe" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 } health_report { overall_health: UNKNOWN } } }
I20260809 06:33:49.736002 16393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.730715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59298 (local address 127.30.78.65:38923)
0809 06:33:49.730947 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.730953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.731019 (+ 66us) server_negotiation.cc:407] Connection header received
0809 06:33:49.731222 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.731225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.731300 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.731430 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:33:49.731800 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.732516 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.733984 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.734360 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.734488 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.734981 (+ 493us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:33:49.735459 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:33:49.735604 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.735687 (+ 83us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.735763 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260809 06:33:49.743400 16295 raft_consensus.cc:1261] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab [term 1 FOLLOWER]: Refusing update from remote peer 7445e78ef5924e76b743a08fcf43acfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:33:49.743506 16092 raft_consensus.cc:1261] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [term 1 FOLLOWER]: Refusing update from remote peer 7445e78ef5924e76b743a08fcf43acfe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:33:49.744174 16409 consensus_queue.cc:1035] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4fba0628c7943d5b26f5bbe3e1d7fab" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 32923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:33:49.744529 16403 consensus_queue.cc:1035] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "3268323e24cf433fb009ce414e2acb39" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 06:33:49.745126 16367 tablet.cc:2369] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:33:49.755276 16413 mvcc.cc:205] Tried to move back new op lower bound from 7316509613020647424 to 7316509612834684928. Current Snapshot: MvccSnapshot[applied={T|T < 7316509613020647424}]
I20260809 06:33:49.768587 15633 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:33:49.768850 15633 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:33:49.772264 15633 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d8b0841bf26d476dbd2f002d13fd6ebf: Sending DeleteTablet for 3 replicas of tablet 8ae31d751f674cbfab29fedccee8e1d1
I20260809 06:33:49.773300 16063 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ae31d751f674cbfab29fedccee8e1d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:33:49 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:43580
I20260809 06:33:49.773509 15858 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ae31d751f674cbfab29fedccee8e1d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:33:49 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:59296
I20260809 06:33:49.774484 16264 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ae31d751f674cbfab29fedccee8e1d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:33:49 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:59958
I20260809 06:33:49.775576 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 15759
I20260809 06:33:49.786211 16438 tablet_replica.cc:330] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: stopping tablet replica
I20260809 06:33:49.786780 16438 raft_consensus.cc:2229] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:33:49.787531 16438 raft_consensus.cc:2258] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:33:49.787583 16441 tablet_replica.cc:330] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: stopping tablet replica
I20260809 06:33:49.787986 16441 raft_consensus.cc:2229] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:33:49.788393 16435 tablet_replica.cc:330] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: stopping tablet replica
I20260809 06:33:49.788630 16441 raft_consensus.cc:2258] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:33:49.788884 16435 raft_consensus.cc:2229] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:33:49.789450 16435 raft_consensus.cc:2258] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:33:49.790812 16438 ts_tablet_manager.cc:1905] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:33:49.791662 16435 ts_tablet_manager.cc:1905] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:33:49.792028 16441 ts_tablet_manager.cc:1905] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 06:33:49 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:33:49.798336 16435 ts_tablet_manager.cc:1918] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:33:49.798625 16435 log.cc:1196] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/8ae31d751f674cbfab29fedccee8e1d1
I20260809 06:33:49.799194 16435 ts_tablet_manager.cc:1939] T 8ae31d751f674cbfab29fedccee8e1d1 P 3268323e24cf433fb009ce414e2acb39: Deleting consensus metadata
I20260809 06:33:49.799543 16441 ts_tablet_manager.cc:1918] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:33:49.799731 16441 log.cc:1196] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/8ae31d751f674cbfab29fedccee8e1d1
I20260809 06:33:49.800225 16441 ts_tablet_manager.cc:1939] T 8ae31d751f674cbfab29fedccee8e1d1 P e4fba0628c7943d5b26f5bbe3e1d7fab: Deleting consensus metadata
I20260809 06:33:49.801314 15614 catalog_manager.cc:4841] TS 3268323e24cf433fb009ce414e2acb39 (127.30.78.66:40509): tablet 8ae31d751f674cbfab29fedccee8e1d1 (table test-table [id=48f93bca49834091b3e7adbded0600fe]) successfully deleted
I20260809 06:33:49.801391 16438 ts_tablet_manager.cc:1918] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:33:49.801546 16438 log.cc:1196] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/8ae31d751f674cbfab29fedccee8e1d1
I20260809 06:33:49.801826 15615 catalog_manager.cc:4841] TS e4fba0628c7943d5b26f5bbe3e1d7fab (127.30.78.67:32923): tablet 8ae31d751f674cbfab29fedccee8e1d1 (table test-table [id=48f93bca49834091b3e7adbded0600fe]) successfully deleted
I20260809 06:33:49.802134 16438 ts_tablet_manager.cc:1939] T 8ae31d751f674cbfab29fedccee8e1d1 P 7445e78ef5924e76b743a08fcf43acfe: Deleting consensus metadata
I20260809 06:33:49.803810 15615 catalog_manager.cc:4841] TS 7445e78ef5924e76b743a08fcf43acfe (127.30.78.65:38923): tablet 8ae31d751f674cbfab29fedccee8e1d1 (table test-table [id=48f93bca49834091b3e7adbded0600fe]) successfully deleted
I20260809 06:33:49.806193 16393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.777348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59304 (local address 127.30.78.65:38923)
0809 06:33:49.777511 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.777518 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.785019 (+ 7501us) server_negotiation.cc:407] Connection header received
0809 06:33:49.785220 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.785226 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.785337 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.785454 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:49.790532 (+ 5078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.791615 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.793480 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.794146 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.794248 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.799625 (+ 5377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:49.799640 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:49.799660 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:49.799711 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:49.803317 (+ 3606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:49.804109 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:49.804119 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:49.804122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:49.804268 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:49.804657 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:49.804661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:49.804663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:49.805016 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:49.805311 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.805636 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.805881 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260809 06:33:49.806773 15941 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:33:49.902798 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 15759
I20260809 06:33:49.931141 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 15960
Aug 09 06:33:49 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:33:49.945458 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:49.931859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43582 (local address 127.30.78.66:40509)
0809 06:33:49.932051 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:49.932056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:49.932110 (+ 54us) server_negotiation.cc:407] Connection header received
0809 06:33:49.932296 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:49.932299 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:49.932359 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:49.932448 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:49.933669 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.934405 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.935659 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:49.936049 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:49.936139 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:49.940346 (+ 4207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:49.940356 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:49.940376 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:49.940406 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:49.942932 (+ 2526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:49.943546 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:49.943553 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:49.943555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:49.943681 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:49.944027 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:49.944032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:49.944034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:49.944387 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:49.944653 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:49.944938 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 06:33:49.945138 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 06:33:49.946110 16155 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:33:50.032506 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 15960
I20260809 06:33:50.055789 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 16171
Aug 09 06:33:50 dist-test-slave-cvwc krb5kdc[14924](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257225, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:33:50.070282 16394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:33:50.056523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59966 (local address 127.30.78.67:32923)
0809 06:33:50.056704 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:33:50.056710 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:33:50.056730 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:33:50.056910 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:33:50.056916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:33:50.056987 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:33:50.057086 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:33:50.058523 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:50.059235 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:50.060514 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:33:50.060913 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:33:50.061024 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:33:50.065033 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:33:50.065048 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:33:50.065065 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:33:50.065097 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:33:50.067612 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:50.068277 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:50.068285 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:50.068287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:50.068417 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:33:50.068759 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:33:50.068763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:33:50.068765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:33:50.069135 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:33:50.069422 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0809 06:33:50.069705 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 06:33:50.069950 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:33:50.070909 16360 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:33:50.157223 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 16171
I20260809 06:33:50.178020 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 15590
I20260809 06:33:50.179132 15679 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:33:50.292749 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 15590
I20260809 06:33:50.320307 31033 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 06:33:50.663899 31033 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 06:33:50.664176 31033 mini_ranger.cc:66] Stopping Ranger...
I20260809 06:33:51.008205 31033 mini_ranger.cc:68] Stopped Ranger
2026-08-09 06:33:51.008 UTC [14966] LOG: received smart shutdown request
2026-08-09 06:33:51.012 UTC [14966] LOG: background worker "logical replication launcher" (PID 14981) exited with exit code 1
2026-08-09 06:33:51.012 UTC [14975] LOG: shutting down
2026-08-09 06:33:51.139 UTC [14966] LOG: database system is shut down
2026-08-09T06:33:51Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48222 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:33:51 dist-test-slave-cvwc krb5kdc[16462](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:33:51 dist-test-slave-cvwc krb5kdc[16462](info): set up 2 sockets
Aug 09 06:33:51 dist-test-slave-cvwc krb5kdc[16462](info): commencing operation
krb5kdc: starting...
W20260809 06:33:52.439971 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.008s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:33:52 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257232, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:33:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:33:52Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.78.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.78.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/rangeradmin_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/rangeradmin_127.30.78.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.78.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.78.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/rangerlookup_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/rangerlookup_127.30.78.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.78.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.78.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/HTTP_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/HTTP_127.30.78.84@KRBTEST.COM.keytab.
I20260809 06:33:52.750492 31033 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasklYlngI/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/postgres -l logfile start
2026-08-09 06:33:54.946 UTC [16506] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-09 06:33:54.946 UTC [16506] LOG: listening on IPv4 address "127.30.78.84", port 37437
2026-08-09 06:33:54.949 UTC [16506] LOG: listening on Unix socket "/tmp/.s.PGSQL.37437"
2026-08-09 06:33:54.970 UTC [16509] LOG: database system was shut down at 2026-08-09 06:33:53 UTC
2026-08-09 06:33:54.973 UTC [16506] LOG: database system is ready to accept connections
I20260809 06:33:56.045675 31033 mini_postgres.cc:96] Postgres bound to 37437
2026-08-09 06:33:56.065 UTC [16523] FATAL: database "slave" does not exist
127.30.78.84:37437 - accepting connections
I20260809 06:33:56.065924 31033 mini_ranger.cc:161] Starting Ranger...
I20260809 06:33:56.092439 31033 mini_ranger.cc:84] Created miniranger Postgres user
I20260809 06:33:56.488016 31033 mini_ranger.cc:87] Created ranger Postgres database
I20260809 06:33:56.488121 31033 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-admin
2026-08-09 06:33:56,782 [I] DB FLAVOR :POSTGRES
2026-08-09 06:33:56,782 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 06:33:56,782 [I] Checking connection..
2026-08-09 06:33:56,782 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-09 06:33:57,022 [I] Checking connection passed.
2026-08-09 06:33:57,022 [I] --------- Verifying version history table ---------
2026-08-09 06:33:57,022 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:33:57,259 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 06:33:57,260 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:33:57,511 [I] Table x_db_version_h does not exist in database ranger
2026-08-09 06:33:57,511 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-09 06:33:57,511 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-09 06:33:57.761 UTC [16622] WARNING: there is no transaction in progress
2026-08-09 06:33:57,769 [I] create_dbversion_catalog.sql file imported successfully
2026-08-09 06:33:57,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-09 06:33:58,009 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-09 06:33:58,009 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 06:33:58,009 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-09 06:33:58,261 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-09 06:33:58,504 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-cvwc.c.gcp-upstream.internal','N') ;"
2026-08-09 06:33:58,748 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 06:33:59,002 [I] Table x_portal_user does not exist in database ranger
2026-08-09 06:33:59,002 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 06:33:59,258 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-09 06:33:59,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 06:33:59,500 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 06:33:59,761 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-09 06:33:59,761 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-09 06:34:00.646 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.660 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.674 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.688 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.705 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.722 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.770 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.776 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.789 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.798 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.807 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.820 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.829 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.834 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.840 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:00.845 UTC [16799] WARNING: there is no transaction in progress
2026-08-09 06:34:01,394 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-09 06:34:01,394 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-09 06:34:01,649 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-09 06:34:01,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-09 06:34:01,885 [I] Table x_portal_user already exists in database 'ranger'
2026-08-09 06:34:01,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-09 06:34:02,138 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-09 06:34:02,139 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-09 06:34:02,388 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-09 06:34:02,638 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-cvwc.c.gcp-upstream.internal';"
2026-08-09 06:34:02,865 [I] CORE_DB_SCHEMA import status has been updated
2026-08-09 06:34:02,866 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-09 06:34:03,116 [I] DB_PATCHES have already been applied
I20260809 06:34:03.122020 31033 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-admin:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasklYlngI/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260809 06:34:03.122103 31033 mini_ranger.cc:193] Using host: 127.30.78.84
I20260809 06:34:03.139413 31033 mini_ranger.cc:227] Ranger admin URL: http://127.30.78.84:40853
Aug 09, 2026 6:34:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:34:03 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:34:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-admin/ews/webapp
Aug 09, 2026 6:34:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 09, 2026 6:34:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 09, 2026 6:34:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-admin/ews/webapp].
Aug 09, 2026 6:34:03 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260809 06:34:04.345213 31033 mini_ranger.cc:160] Time spent starting Ranger: real 8.279s user 0.004s sys 0.042s
Aug 09, 2026 6:34:22 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 09, 2026 6:34:23 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 09, 2026 6:34:23 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 09, 2026 6:34:23 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 09, 2026 6:34:23 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260809 06:34:24.559077 31033 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.78.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.78.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/rangerkms_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.78.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/rangerkms_127.30.78.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.78.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.78.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.78.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/HTTP_127.30.78.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.78.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/HTTP_127.30.78.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 09 06:34:24 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257264, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260809 06:34:24.734040 31033 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260809 06:34:24.753571 31033 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260809 06:34:25.487211 31033 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260809 06:34:25.487309 31033 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-kms
I20260809 06:34:25.487341 31033 mini_ranger_kms.cc:227] Using postgres at 127.30.78.84:37437
2026-08-09 06:34:25,845 [I] DB FLAVOR :POSTGRES
2026-08-09 06:34:25,845 [I] --------- Verifying Ranger DB connection ---------
2026-08-09 06:34:25,845 [I] Checking connection
2026-08-09 06:34:25,845 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-09 06:34:26,133 [I] connection success
2026-08-09 06:34:26,133 [I] --------- Verifying Ranger DB tables ---------
2026-08-09 06:34:26,133 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-09 06:34:26,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-09 06:34:26,566 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-09 06:34:26,567 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-09 06:34:26,567 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-09 06:34:26,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.78.84:37437/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-09 06:34:26,851 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260809 06:34:27.295459 31033 mini_ranger_kms.cc:310] Created kms service
I20260809 06:34:27.475862 31033 mini_ranger_kms.cc:326] Created kudu user
I20260809 06:34:27.516773 31033 mini_ranger_kms.cc:343] Created rangerkms user
Aug 09 06:34:27 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257264, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:27.914803 31033 mini_ranger_kms.cc:384] Added ranger policy
I20260809 06:34:27.915131 31033 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-kms:/tmp/dist-test-tasklYlngI/build/asan/bin/postgresql.jar:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasklYlngI/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260809 06:34:27.915191 31033 mini_ranger_kms.cc:240] Using host: 127.30.78.84
I20260809 06:34:27.936271 31033 mini_ranger_kms.cc:276] Ranger KMS PID: 17085
I20260809 06:34:27.936408 31033 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.78.84:60829
Aug 09, 2026 6:34:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 09, 2026 6:34:28 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 09, 2026 6:34:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 09, 2026 6:34:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 09, 2026 6:34:29 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-kms/ews/webapp].
Aug 09, 2026 6:34:29 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 09 06:34:30 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786257270, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.78.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:30.456518 31033 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.722s user 0.058s sys 0.325s
I20260809 06:34:30.456791 31033 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260809 06:34:30.456969 31033 mini_ranger_kms.cc:401] 127.30.78.84:60829/kms/v1/keys
Aug 09 06:34:30 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257270, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.78.84@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
Aug 09 06:34:30 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257270, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.78.84@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
Aug 09 06:34:33 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:34:33.219574 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43113
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:43113
--ranger_config_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:60829/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:33.558914 17159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:33.559229 17159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:33.559378 17159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:33.566571 17159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:34:33.566696 17159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:33.566781 17159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:33.566864 17159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:34:33.566936 17159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:34:33.577358 17159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.78.84:60829/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:43113
--ranger_config_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:33.578680 17159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:33.580041 17159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:33.591221 17170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:33.591308 17171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:33.591329 17175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:33.592361 17159 server_base.cc:1034] running on GCE node
I20260809 06:34:33.593125 17159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:33.594480 17159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:33.595697 17159 hybrid_clock.cc:648] HybridClock initialized: now 1786257273595649 us; error 33 us; skew 500 ppm
I20260809 06:34:33.596053 17159 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:33 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257273, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:33.599089 17159 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:34:33.600482 17159 webserver.cc:460] Webserver started at http://127.30.78.126:38231/ using document root <none> and password file <none>
I20260809 06:34:33.601076 17159 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:33.601184 17159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:33.601470 17159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:34:33 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257273, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:33.657925 17159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "10d0388ea495445ebc9ac3c9f9429ab3"
format_stamp: "Formatted at 2026-08-09 06:34:33 on dist-test-slave-cvwc"
server_key: "3adbe35cd11ffea58c1368263d93d6a5"
server_key_iv: "78921bcbb778d7bf116781bc21dce542"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:33.658818 17159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "10d0388ea495445ebc9ac3c9f9429ab3"
format_stamp: "Formatted at 2026-08-09 06:34:33 on dist-test-slave-cvwc"
server_key: "3adbe35cd11ffea58c1368263d93d6a5"
server_key_iv: "78921bcbb778d7bf116781bc21dce542"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:33.664269 17159 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:34:33.680171 17186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:33.681640 17159 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260809 06:34:33.681856 17159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "10d0388ea495445ebc9ac3c9f9429ab3"
format_stamp: "Formatted at 2026-08-09 06:34:33 on dist-test-slave-cvwc"
server_key: "3adbe35cd11ffea58c1368263d93d6a5"
server_key_iv: "78921bcbb778d7bf116781bc21dce542"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:33.682065 17159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:33.699411 17159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:33.703152 17159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:33.703440 17159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:33.720786 17159 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:43113
I20260809 06:34:33.720793 17261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:43113 every 8 connection(s)
I20260809 06:34:33.722150 17159 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:34:33.725791 17262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:33.732547 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 17159
I20260809 06:34:33.732748 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:34:33.733430 31033 external_mini_cluster.cc:1428] Setting key 10f1c976fb35d48fa639420c17b9fc8f
I20260809 06:34:33.735602 17262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Bootstrap starting.
I20260809 06:34:33.738732 17262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:33.739987 17262 log.cc:824] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:33.742913 17262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: No bootstrap required, opened a new log
Aug 09 06:34:33 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:33.752343 17262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } }
I20260809 06:34:33.752750 17262 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:33.752844 17262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d0388ea495445ebc9ac3c9f9429ab3, State: Initialized, Role: FOLLOWER
I20260809 06:34:33.753500 17262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } }
I20260809 06:34:33.753826 17262 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:34:33.753988 17262 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:34:33.754179 17262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:33.756799 17267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:33.735340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52720 (local address 127.30.78.126:43113)
0809 06:34:33.736084 (+ 744us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:33.736096 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:33.736135 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:34:33.737871 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:33.737894 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:33.738240 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:33.738553 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:33.740187 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:33.741528 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:33.743299 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:33.743946 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:33.744077 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:33.748516 (+ 4439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:33.748527 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:33.748550 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:33.748593 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:33.752355 (+ 3762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:33.753107 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:33.753116 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:33.753124 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:33.753300 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:33.753662 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:33.753668 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:33.753671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:33.754430 (+ 759us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:33.754724 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:33.755069 (+ 345us) server_negotiation.cc:299] Negotiation successful
0809 06:34:33.755498 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":358,"threads_started":1}
I20260809 06:34:33.757309 17262 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } }
I20260809 06:34:33.757891 17262 leader_election.cc:302] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10d0388ea495445ebc9ac3c9f9429ab3; no voters:
I20260809 06:34:33.758510 17262 leader_election.cc:288] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:34:33.758652 17269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:34:33.760002 17269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 1 LEADER]: Becoming Leader. State: Replica: 10d0388ea495445ebc9ac3c9f9429ab3, State: Running, Role: LEADER
I20260809 06:34:33.760542 17269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } }
I20260809 06:34:33.760691 17262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:34:33.764348 17275 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10d0388ea495445ebc9ac3c9f9429ab3. Latest consensus state: current_term: 1 leader_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } } }
I20260809 06:34:33.764760 17275 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:33.765187 17272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } } }
I20260809 06:34:33.765471 17272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:33.768673 17287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:34:33.769054 17262 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260809 06:34:33.781100 17287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:34:33.791699 17287 catalog_manager.cc:1347] Generated new cluster ID: 8e95759416cb42f692f4124b24b2887a
I20260809 06:34:33.791812 17287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:34:33.813632 17287 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:34:33.815542 17287 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:34:33.825143 17287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Generated new TSK 0
I20260809 06:34:33.826172 17287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:34:34.593916 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43113
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:34:34 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786257274, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260809 06:34:35.000048 17331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:35.000334 17331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:35.000500 17331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:35.008368 17331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:35.008476 17331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:35.008649 17331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:34:35.019402 17331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.78.84:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:35.020810 17331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:35.022210 17331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:35.037390 17344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:35.037925 17348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:35.043298 17331 server_base.cc:1034] running on GCE node
W20260809 06:34:35.043555 17353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:35.044246 17331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:35.045986 17331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:35.047258 17331 hybrid_clock.cc:648] HybridClock initialized: now 1786257275047166 us; error 76 us; skew 500 ppm
I20260809 06:34:35.047688 17331 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:35 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257275, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:35.054764 17331 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:34:35.056591 17331 webserver.cc:460] Webserver started at http://127.30.78.65:40533/ using document root <none> and password file <none>
I20260809 06:34:35.057293 17331 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:35.057416 17331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:35.057762 17331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:34:35 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257275, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:35.082777 17331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "130cae43957e4d9aad40b092a2d7af2d"
format_stamp: "Formatted at 2026-08-09 06:34:35 on dist-test-slave-cvwc"
server_key: "ec2f360c240cc86ff6a537e9525d78e2"
server_key_iv: "5950cc476a6346a2cde93e9281e7c7d6"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:35.086107 17331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "130cae43957e4d9aad40b092a2d7af2d"
format_stamp: "Formatted at 2026-08-09 06:34:35 on dist-test-slave-cvwc"
server_key: "ec2f360c240cc86ff6a537e9525d78e2"
server_key_iv: "5950cc476a6346a2cde93e9281e7c7d6"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:35.091858 17331 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:34:35.126362 17361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:35.128309 17331 fs_manager.cc:725] Time spent opening block manager: real 0.020s user 0.007s sys 0.012s
I20260809 06:34:35.128602 17331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "130cae43957e4d9aad40b092a2d7af2d"
format_stamp: "Formatted at 2026-08-09 06:34:35 on dist-test-slave-cvwc"
server_key: "ec2f360c240cc86ff6a537e9525d78e2"
server_key_iv: "5950cc476a6346a2cde93e9281e7c7d6"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:35.129012 17331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:35.168623 17331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:35.174461 17331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:35.174908 17331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:35.189886 17331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:35.198351 17331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:35.198549 17331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260809 06:34:35.198776 17331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:35.198913 17331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 09 06:34:35 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257274, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:35.514420 17331 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:34291
I20260809 06:34:35.514442 17536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:34291 every 8 connection(s)
I20260809 06:34:35.516382 17331 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:34:35.526530 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 17331
I20260809 06:34:35.526764 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:34:35.527510 31033 external_mini_cluster.cc:1428] Setting key c6051c260e26e245dc8f1dc3787752c8
Aug 09 06:34:35 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257275, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:35.560034 17541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:35.520624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:59497 (local address 127.30.78.126:43113)
0809 06:34:35.541699 (+ 21075us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:35.541706 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:35.542901 (+ 1195us) server_negotiation.cc:407] Connection header received
0809 06:34:35.545242 (+ 2341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:35.545249 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:35.545347 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:35.545460 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:35.547136 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:35.547937 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:35.549598 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:35.550222 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:35.550348 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:35.553839 (+ 3491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:35.553846 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:35.553849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:35.553885 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:35.556655 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:35.557408 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:35.557413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:35.557416 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:35.557552 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:35.558077 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:35.558083 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:35.558085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:35.558388 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:35.558550 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:35.559406 (+ 856us) server_negotiation.cc:299] Negotiation successful
0809 06:34:35.559634 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20936,"thread_start_us":20808,"threads_started":1}
I20260809 06:34:35.561172 17540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:35.519980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43113 (local address 127.30.78.65:59497)
0809 06:34:35.542337 (+ 22357us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:35.542409 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:35.544862 (+ 2453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:35.545798 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:35.545813 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:35.546321 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:35.546943 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:35.546962 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:35.548115 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:35.548121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:35.549438 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:35.549453 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:35.550474 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:35.550482 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:35.550739 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:35.551425 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:35.551450 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:35.553570 (+ 2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:35.556803 (+ 3233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:35.556813 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:35.556831 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:35.557280 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:35.557665 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:35.557671 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:35.557675 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:35.557956 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:35.558548 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:35.558556 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:35.558919 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 06:34:35.559297 (+ 378us) client_negotiation.cc:240] Negotiation successful
0809 06:34:35.559833 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22030,"thread_start_us":21796,"threads_started":1}
I20260809 06:34:35.562806 17537 heartbeater.cc:347] Connected to a master server at 127.30.78.126:43113
I20260809 06:34:35.563164 17537 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:35.564055 17537 heartbeater.cc:511] Master 127.30.78.126:43113 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
I20260809 06:34:35.567059 17213 ts_manager.cc:194] Registered new tserver with Master: 130cae43957e4d9aad40b092a2d7af2d (127.30.78.65:34291)
I20260809 06:34:35.568856 17213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:59497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:34:35.598752 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43113
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:34:35 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257274, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
W20260809 06:34:36.004796 17548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:36.005064 17548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:36.005221 17548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:36.015224 17548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:36.015413 17548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:36.015632 17548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:34:36.028565 17548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.78.84:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:36.029968 17548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:36.031330 17548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:36.046274 17573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:36.046567 17570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:36.047061 17548 server_base.cc:1034] running on GCE node
W20260809 06:34:36.048488 17577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:36.049115 17548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:36.050005 17548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:36.051204 17548 hybrid_clock.cc:648] HybridClock initialized: now 1786257276051156 us; error 39 us; skew 500 ppm
I20260809 06:34:36.051498 17548 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:36 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257276, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:36.054404 17548 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:34:36.055696 17548 webserver.cc:460] Webserver started at http://127.30.78.66:33997/ using document root <none> and password file <none>
I20260809 06:34:36.056315 17548 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:36.056438 17548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:36.056718 17548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:34:36 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257276, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:36.070837 17548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "c315614ebae94b27890c4ef11887c597"
format_stamp: "Formatted at 2026-08-09 06:34:36 on dist-test-slave-cvwc"
server_key: "2f02f347bde1516a7595ed3b87cb983c"
server_key_iv: "c6343c36bc938be9006a1c731148ab99"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:36.071614 17548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "c315614ebae94b27890c4ef11887c597"
format_stamp: "Formatted at 2026-08-09 06:34:36 on dist-test-slave-cvwc"
server_key: "2f02f347bde1516a7595ed3b87cb983c"
server_key_iv: "c6343c36bc938be9006a1c731148ab99"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:36.076974 17548 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 06:34:36.090502 17589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:36.091910 17548 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:34:36.092070 17548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "c315614ebae94b27890c4ef11887c597"
format_stamp: "Formatted at 2026-08-09 06:34:36 on dist-test-slave-cvwc"
server_key: "2f02f347bde1516a7595ed3b87cb983c"
server_key_iv: "c6343c36bc938be9006a1c731148ab99"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:36.092274 17548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:36.104547 17548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:36.108194 17548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:36.108462 17548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:36.109295 17548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:36.110579 17548 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:36.110656 17548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:36.110777 17548 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:36.110831 17548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:36.139775 17548 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:36731
I20260809 06:34:36.139807 17780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:36731 every 8 connection(s)
I20260809 06:34:36.140931 17548 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:34:36.144840 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 17548
I20260809 06:34:36.144981 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:34:36.145443 31033 external_mini_cluster.cc:1428] Setting key 0528d96d97cb7b405fbfc711ade1b216
Aug 09 06:34:36 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257276, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:36.159186 17785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:36.143234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:41065 (local address 127.30.78.126:43113)
0809 06:34:36.143677 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:36.143682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:36.144458 (+ 776us) server_negotiation.cc:407] Connection header received
0809 06:34:36.146396 (+ 1938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:36.146402 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:36.146501 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:36.146598 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:36.148039 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.148792 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.150303 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.150700 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.150817 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:36.153829 (+ 3012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:36.153834 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:36.153837 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:36.153867 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:36.156297 (+ 2430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:36.156951 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:36.156956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:36.156958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:36.157074 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:36.157463 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:36.157468 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:36.157471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:36.157786 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:36.157917 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:36.158769 (+ 852us) server_negotiation.cc:299] Negotiation successful
0809 06:34:36.158931 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":227,"threads_started":1}
I20260809 06:34:36.160363 17786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:36.143634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43113 (local address 127.30.78.66:41065)
0809 06:34:36.144305 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:36.144342 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:36.146111 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:36.146843 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:36.146851 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:36.147343 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:36.147884 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:36.147900 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.148938 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.148941 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:36.150173 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:36.150185 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.150921 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.150928 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:36.151135 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:36.151697 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:36.151718 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:36.153599 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:36.156424 (+ 2825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:36.156432 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:36.156446 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:36.156838 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:36.157176 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:36.157181 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:36.157185 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:36.157359 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:36.158029 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:36.158037 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:36.158386 (+ 349us) client_negotiation.cc:769] Sending connection context
0809 06:34:36.158687 (+ 301us) client_negotiation.cc:240] Negotiation successful
0809 06:34:36.159132 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":256,"threads_started":1}
I20260809 06:34:36.161798 17781 heartbeater.cc:347] Connected to a master server at 127.30.78.126:43113
I20260809 06:34:36.162074 17781 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:36.162770 17781 heartbeater.cc:511] Master 127.30.78.126:43113 requested a full tablet report, sending...
I20260809 06:34:36.164222 17213 ts_manager.cc:194] Registered new tserver with Master: c315614ebae94b27890c4ef11887c597 (127.30.78.66:36731)
I20260809 06:34:36.165328 17213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:41065
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:34:36.200120 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43113
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:36.516306 17790 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:36.516564 17790 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:36.516705 17790 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:36.523674 17790 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:36.523790 17790 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:36.523942 17790 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:34:36.533105 17790 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.78.84:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:36.534255 17790 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:36.535429 17790 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:36.547509 17797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:36.547480 17798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:36.547437 17800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:36.548364 17790 server_base.cc:1034] running on GCE node
I20260809 06:34:36.548926 17790 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:36.549796 17790 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:36.550987 17790 hybrid_clock.cc:648] HybridClock initialized: now 1786257276550942 us; error 37 us; skew 500 ppm
I20260809 06:34:36.551262 17790 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:36 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257276, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:36.554164 17790 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:34:36.555439 17790 webserver.cc:460] Webserver started at http://127.30.78.67:36617/ using document root <none> and password file <none>
I20260809 06:34:36.556031 17790 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:36.556128 17790 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:36.556375 17790 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 09 06:34:36 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257276, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:36.570392 17790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "17eda241af2047f49049505a7c949958"
format_stamp: "Formatted at 2026-08-09 06:34:36 on dist-test-slave-cvwc"
server_key: "28cb7505b1f8ce9c7b2dbfbab912ac63"
server_key_iv: "9ae36173628e4e1ff5f6a3088f85f7f0"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:36.571211 17790 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "17eda241af2047f49049505a7c949958"
format_stamp: "Formatted at 2026-08-09 06:34:36 on dist-test-slave-cvwc"
server_key: "28cb7505b1f8ce9c7b2dbfbab912ac63"
server_key_iv: "9ae36173628e4e1ff5f6a3088f85f7f0"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:36.572432 17537 heartbeater.cc:503] Master 127.30.78.126:43113 was elected leader, sending a full tablet report...
I20260809 06:34:36.576943 17790 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260809 06:34:36.590639 17813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:36.592113 17790 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:34:36.592269 17790 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "17eda241af2047f49049505a7c949958"
format_stamp: "Formatted at 2026-08-09 06:34:36 on dist-test-slave-cvwc"
server_key: "28cb7505b1f8ce9c7b2dbfbab912ac63"
server_key_iv: "9ae36173628e4e1ff5f6a3088f85f7f0"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:36.592474 17790 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:36.607115 17790 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:36.611011 17790 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:36.611270 17790 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:36.612224 17790 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:36.613602 17790 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:36.613674 17790 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:36.613816 17790 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:36.613871 17790 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:36.653981 17790 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:33303
I20260809 06:34:36.653985 18009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:33303 every 8 connection(s)
I20260809 06:34:36.655239 17790 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:34:36.660516 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 17790
I20260809 06:34:36.661175 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:34:36.661903 31033 external_mini_cluster.cc:1428] Setting key 02e15f2f9bd2e4b65107959093388649
Aug 09 06:34:36 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257276, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:36.678069 17785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:36.657932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:47915 (local address 127.30.78.126:43113)
0809 06:34:36.658139 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:36.658145 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:36.659278 (+ 1133us) server_negotiation.cc:407] Connection header received
0809 06:34:36.661415 (+ 2137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:36.661421 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:36.661534 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:36.661613 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:36.663772 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.664727 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.666734 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.667436 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.667561 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:36.671346 (+ 3785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:36.671351 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:36.671355 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:36.671390 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:36.674244 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:36.675231 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:36.675235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:36.675237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:36.675378 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:36.675862 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:36.675868 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:36.675871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:36.676213 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:36.676386 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:36.677497 (+ 1111us) server_negotiation.cc:299] Negotiation successful
0809 06:34:36.677763 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:34:36.679127 18012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:36.658303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43113 (local address 127.30.78.67:47915)
0809 06:34:36.659095 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:36.659145 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:36.661092 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:36.662177 (+ 1085us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:36.662188 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:36.662769 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:36.663569 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:36.663597 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.664992 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.664998 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:36.666578 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:36.666593 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.667689 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.667695 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:36.667917 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:36.668627 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:36.668652 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:36.671084 (+ 2432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:36.674404 (+ 3320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:36.674413 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:36.674430 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:36.675113 (+ 683us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:36.675479 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:36.675483 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:36.675509 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:36.675738 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:36.676388 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:36.676396 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:36.676775 (+ 379us) client_negotiation.cc:769] Sending connection context
0809 06:34:36.677073 (+ 298us) client_negotiation.cc:240] Negotiation successful
0809 06:34:36.677603 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":344,"threads_started":1}
I20260809 06:34:36.680509 18010 heartbeater.cc:347] Connected to a master server at 127.30.78.126:43113
I20260809 06:34:36.680805 18010 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:36.681504 18010 heartbeater.cc:511] Master 127.30.78.126:43113 requested a full tablet report, sending...
I20260809 06:34:36.683038 17213 ts_manager.cc:194] Registered new tserver with Master: 17eda241af2047f49049505a7c949958 (127.30.78.67:33303)
I20260809 06:34:36.683876 17213 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:47915
I20260809 06:34:36.689980 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:34:36.692409 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 17331
Aug 09 06:34:36 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:34:36.711155 18016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:36.693434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51670 (local address 127.30.78.65:34291)
0809 06:34:36.694200 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:36.694208 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:36.694602 (+ 394us) server_negotiation.cc:407] Connection header received
0809 06:34:36.694772 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:36.694781 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:36.695001 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:36.695149 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:36.696871 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.698548 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.700033 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.700863 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.700985 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:36.705623 (+ 4638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:36.705633 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:36.705645 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:36.705680 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:36.708340 (+ 2660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:36.709163 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:36.709169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:36.709171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:36.709306 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:36.709672 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:36.709675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:36.709677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:36.710018 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:36.710241 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:36.710626 (+ 385us) server_negotiation.cc:299] Negotiation successful
0809 06:34:36.710839 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":446,"threads_started":1}
I20260809 06:34:36.712496 17532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:36.862684 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 17331
I20260809 06:34:36.882472 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 17548
Aug 09 06:34:36 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:34:36.898636 18019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:36.883353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54468 (local address 127.30.78.66:36731)
0809 06:34:36.883940 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:36.883946 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:36.883971 (+ 25us) server_negotiation.cc:407] Connection header received
0809 06:34:36.884031 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:36.884038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:36.884239 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:36.884406 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:36.885732 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.886759 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.888076 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:36.888611 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:36.888724 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:36.893009 (+ 4285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:36.893019 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:36.893033 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:36.893069 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:36.895736 (+ 2667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:36.896443 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:36.896450 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:36.896453 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:36.896584 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:36.897013 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:36.897016 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:36.897018 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:36.897405 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:36.897688 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:36.898018 (+ 330us) server_negotiation.cc:299] Negotiation successful
0809 06:34:36.898273 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":302,"threads_started":1}
I20260809 06:34:36.899788 17769 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:36.979282 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 17548
I20260809 06:34:37.002079 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 17790
Aug 09 06:34:37 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:34:37.017268 18024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:37.003066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36580 (local address 127.30.78.67:33303)
0809 06:34:37.003730 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:37.003737 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:37.003767 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:34:37.003827 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:37.003833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:37.004084 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:37.004212 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:37.005529 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:37.006627 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:37.007858 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:37.008386 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:37.008475 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:37.012484 (+ 4009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:37.012494 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:37.012507 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:37.012542 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:37.015045 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:37.015619 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:37.015625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:37.015627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:37.015742 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:37.015994 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:37.015997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:37.015998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:37.016293 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:37.016515 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:37.016730 (+ 215us) server_negotiation.cc:299] Negotiation successful
0809 06:34:37.016920 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":373,"threads_started":1}
I20260809 06:34:37.018567 18001 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:37.098488 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 17790
I20260809 06:34:37.118317 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 17159
I20260809 06:34:37.119537 17256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:37.224077 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 17159
I20260809 06:34:37.252310 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43113
--webserver_interface=127.30.78.126
--webserver_port=38231
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:43113
--ranger_config_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:60829/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.78.84:60829/kms with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:37.570767 18040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:37.571028 18040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:37.571151 18040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:37.578066 18040 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:34:37.578171 18040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:37.578246 18040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:37.578320 18040 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:34:37.578387 18040 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:34:37.588100 18040 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.78.84:60829/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:43113
--ranger_config_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=38231
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:37.589308 18040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:37.590651 18040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:37.601503 18053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:37.601547 18050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:37.601576 18049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:37.602372 18040 server_base.cc:1034] running on GCE node
I20260809 06:34:37.603066 18040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:37.604295 18040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:37.605475 18040 hybrid_clock.cc:648] HybridClock initialized: now 1786257277605424 us; error 46 us; skew 500 ppm
I20260809 06:34:37.605826 18040 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:37 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257277, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:37.608772 18040 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:34:37.610091 18040 webserver.cc:460] Webserver started at http://127.30.78.126:38231/ using document root <none> and password file <none>
I20260809 06:34:37.610670 18040 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:37.610785 18040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 06:34:37 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257277, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:37.652505 18040 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:34:37.655386 18061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:37.656620 18040 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:34:37.656777 18040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "10d0388ea495445ebc9ac3c9f9429ab3"
format_stamp: "Formatted at 2026-08-09 06:34:33 on dist-test-slave-cvwc"
server_key: "3adbe35cd11ffea58c1368263d93d6a5"
server_key_iv: "78921bcbb778d7bf116781bc21dce542"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:37.657701 18040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:37.670485 18040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:37.674045 18040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:37.674288 18040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:37.690855 18040 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:43113
I20260809 06:34:37.690884 18144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:43113 every 8 connection(s)
I20260809 06:34:37.692204 18040 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:34:37.693971 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 18040
I20260809 06:34:37.694762 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:34291
--local_ip_for_outbound_sockets=127.30.78.65
--tserver_master_addrs=127.30.78.126:43113
--webserver_port=40533
--webserver_interface=127.30.78.65
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.78.84:60829/kms with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:34:37.698751 18146 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:34:37.701813 18146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Bootstrap starting.
I20260809 06:34:37.719936 18146 log.cc:824] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:37.728112 18146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:34:37.728578 18146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Bootstrap complete.
I20260809 06:34:37.736904 18146 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } }
I20260809 06:34:37.737696 18146 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10d0388ea495445ebc9ac3c9f9429ab3, State: Initialized, Role: FOLLOWER
I20260809 06:34:37.738263 18146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } }
I20260809 06:34:37.738497 18146 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:34:37.738608 18146 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:34:37.738790 18146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:34:37.742360 18146 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } }
I20260809 06:34:37.742787 18146 leader_election.cc:302] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10d0388ea495445ebc9ac3c9f9429ab3; no voters:
I20260809 06:34:37.743310 18146 leader_election.cc:288] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 06:34:37.743513 18150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 06:34:37.744382 18150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [term 2 LEADER]: Becoming Leader. State: Replica: 10d0388ea495445ebc9ac3c9f9429ab3, State: Running, Role: LEADER
I20260809 06:34:37.745119 18146 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:34:37.744998 18150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } }
I20260809 06:34:37.747562 18154 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10d0388ea495445ebc9ac3c9f9429ab3. Latest consensus state: current_term: 2 leader_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } } }
I20260809 06:34:37.747961 18154 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:37.748453 18152 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10d0388ea495445ebc9ac3c9f9429ab3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43113 } } }
I20260809 06:34:37.748714 18152 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:37.758387 18164 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:34:37.764407 18164 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:34:37.765862 18164 catalog_manager.cc:1259] Loaded cluster ID: 8e95759416cb42f692f4124b24b2887a
I20260809 06:34:37.766016 18164 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:34:37.770129 18164 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:34:37.771556 18164 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Loaded TSK: 0
I20260809 06:34:37.773200 18164 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:34:37.775543 18146 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260809 06:34:38.120765 18148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:38.121271 18148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:38.121490 18148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:38.132747 18148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:38.132893 18148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:38.133083 18148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:34:38.148046 18148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.78.84:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:34291
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=40533
--tserver_master_addrs=127.30.78.126:43113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:38.149771 18148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:38.151535 18148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:38.172838 18205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:38.180401 18204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:38.193990 18148 server_base.cc:1034] running on GCE node
W20260809 06:34:38.194782 18207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:38.195659 18148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:38.197034 18148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:38.200436 18148 hybrid_clock.cc:648] HybridClock initialized: now 1786257278200374 us; error 47 us; skew 500 ppm
I20260809 06:34:38.200907 18148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:38 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257278, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:38.205325 18148 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:34:38.210455 18148 webserver.cc:460] Webserver started at http://127.30.78.65:40533/ using document root <none> and password file <none>
I20260809 06:34:38.211495 18148 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:38.211678 18148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 06:34:38 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257278, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:38.243043 18148 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.004s sys 0.000s
I20260809 06:34:38.252823 18217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:38.254719 18148 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.005s sys 0.004s
I20260809 06:34:38.254978 18148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "130cae43957e4d9aad40b092a2d7af2d"
format_stamp: "Formatted at 2026-08-09 06:34:35 on dist-test-slave-cvwc"
server_key: "ec2f360c240cc86ff6a537e9525d78e2"
server_key_iv: "5950cc476a6346a2cde93e9281e7c7d6"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:38.256120 18148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:38.291952 18148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:38.296180 18148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:38.296454 18148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:38.297511 18148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:38.299227 18148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:38.299338 18148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:38.299450 18148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:38.299523 18148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:38.341585 18148 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:34291
I20260809 06:34:38.341666 18395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:34291 every 8 connection(s)
I20260809 06:34:38.343536 18148 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:34:38.347755 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 18148
I20260809 06:34:38.348640 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:36731
--local_ip_for_outbound_sockets=127.30.78.66
--tserver_master_addrs=127.30.78.126:43113
--webserver_port=33997
--webserver_interface=127.30.78.66
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.78.84:60829/kms with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:34:38 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257278, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:38.397480 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:38.347162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43113 (local address 127.30.78.65:58535)
0809 06:34:38.369865 (+ 22703us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:38.369920 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:38.372621 (+ 2701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:38.376071 (+ 3450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:38.376081 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:38.376772 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:38.378230 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:38.378256 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:38.380672 (+ 2416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:38.380677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:38.382726 (+ 2049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:38.382743 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:38.384506 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:38.384513 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:38.384798 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:38.385565 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:38.385595 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:38.388227 (+ 2632us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:38.392391 (+ 4164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:38.392400 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:38.392414 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:38.392978 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:38.393555 (+ 577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:38.393560 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:38.393563 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:38.393826 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:38.394899 (+ 1073us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:38.394906 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:38.395299 (+ 393us) client_negotiation.cc:769] Sending connection context
0809 06:34:38.395590 (+ 291us) client_negotiation.cc:240] Negotiation successful
0809 06:34:38.396127 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22361,"thread_start_us":27767,"threads_started":1}
I20260809 06:34:38.399716 18402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:38.348291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:58535 (local address 127.30.78.126:43113)
0809 06:34:38.369014 (+ 20723us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:38.369034 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:38.373167 (+ 4133us) server_negotiation.cc:407] Connection header received
0809 06:34:38.373602 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:38.373621 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:38.374201 (+ 580us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:38.374647 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:38.378509 (+ 3862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:38.380446 (+ 1937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:38.382927 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:38.383959 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:38.384103 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:38.388522 (+ 4419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:38.388532 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:38.388550 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:38.388596 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:38.392226 (+ 3630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:38.393153 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:38.393162 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:38.393171 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:38.393402 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:38.393974 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:38.393979 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:38.393982 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:38.394628 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:38.394821 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:38.398197 (+ 3376us) server_negotiation.cc:299] Negotiation successful
0809 06:34:38.398608 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20389,"thread_start_us":20639,"threads_started":1}
I20260809 06:34:38.403806 18397 heartbeater.cc:347] Connected to a master server at 127.30.78.126:43113
I20260809 06:34:38.404107 18397 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:38.404973 18397 heartbeater.cc:511] Master 127.30.78.126:43113 requested a full tablet report, sending...
W20260809 06:34:38.408193 18397 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:43113 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 06:34:38.408443 18397 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:38.408710 18397 heartbeater.cc:511] Master 127.30.78.126:43113 requested a full tablet report, sending...
I20260809 06:34:38.409953 18397 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:38.410214 18397 heartbeater.cc:511] Master 127.30.78.126:43113 requested a full tablet report, sending...
W20260809 06:34:38.411476 18397 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:34:38.744779 18403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:38.745028 18403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:38.745141 18403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:38.752275 18403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:38.752393 18403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:38.752564 18403 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:34:38.762483 18403 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.78.84:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:36731
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=33997
--tserver_master_addrs=127.30.78.126:43113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:38.763710 18403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:38.765161 18403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:38.779799 18423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:38.779745 18424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:38.779866 18426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:38.781422 18403 server_base.cc:1034] running on GCE node
I20260809 06:34:38.782171 18403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:38.783347 18403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:38.784646 18403 hybrid_clock.cc:648] HybridClock initialized: now 1786257278784577 us; error 42 us; skew 500 ppm
I20260809 06:34:38.785014 18403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:38 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257278, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:38.788846 18403 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:34:38.790897 18403 webserver.cc:460] Webserver started at http://127.30.78.66:33997/ using document root <none> and password file <none>
I20260809 06:34:38.791864 18403 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:38.792037 18403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 06:34:38 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257278, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:38.825902 18403 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.001s sys 0.004s
I20260809 06:34:38.829609 18454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:38.831444 18403 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260809 06:34:38.831624 18403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "c315614ebae94b27890c4ef11887c597"
format_stamp: "Formatted at 2026-08-09 06:34:36 on dist-test-slave-cvwc"
server_key: "2f02f347bde1516a7595ed3b87cb983c"
server_key_iv: "c6343c36bc938be9006a1c731148ab99"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:38.833021 18403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:38.871043 18403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:38.876139 18403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:38.876507 18403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:38.890162 18403 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:38.891676 18403 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:38.891772 18403 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:38.891886 18403 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:38.891953 18403 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:38.950934 18403 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:36731
I20260809 06:34:38.950981 18635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:36731 every 8 connection(s)
I20260809 06:34:38.952440 18403 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:34:38.955657 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 18403
I20260809 06:34:38.956451 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.78.84:60829/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:33303
--local_ip_for_outbound_sockets=127.30.78.67
--tserver_master_addrs=127.30.78.126:43113
--webserver_port=36617
--webserver_interface=127.30.78.67
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.78.84:60829/kms with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:34:38 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257278, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
Aug 09 06:34:38 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786257278, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:38.996942 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:38.955176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:44499 (local address 127.30.78.126:43113)
0809 06:34:38.978759 (+ 23583us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:38.978766 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:38.978786 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:34:38.978849 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:38.978853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:38.978941 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:38.979041 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:38.981320 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:38.982421 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:38.984704 (+ 2283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:38.985373 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:38.985473 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:38.989938 (+ 4465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:38.989945 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:38.989950 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:38.989991 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:38.993318 (+ 3327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:38.994235 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:38.994241 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:38.994245 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:38.994413 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:38.994946 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:38.994951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:38.994955 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:38.995281 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:38.995418 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:38.996332 (+ 914us) server_negotiation.cc:299] Negotiation successful
0809 06:34:38.996552 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23449,"thread_start_us":23963,"threads_started":1}
I20260809 06:34:38.999369 18643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:38.955801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43113 (local address 127.30.78.66:44499)
0809 06:34:38.975694 (+ 19893us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:38.975767 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:38.978065 (+ 2298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:38.979546 (+ 1481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:38.979558 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:38.980203 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:38.981086 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:38.981111 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:38.982624 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:38.982629 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:38.984532 (+ 1903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:38.984548 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:38.985863 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:38.985872 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:38.986160 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:38.986886 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:38.986919 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:38.989643 (+ 2724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:38.993473 (+ 3830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:38.993482 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:38.993499 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:38.994110 (+ 611us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:38.994550 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:38.994555 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:38.994559 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:38.994819 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:38.995508 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:38.995516 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:38.995925 (+ 409us) client_negotiation.cc:769] Sending connection context
0809 06:34:38.997455 (+ 1530us) client_negotiation.cc:240] Negotiation successful
0809 06:34:38.998034 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19516,"thread_start_us":21816,"threads_started":1}
I20260809 06:34:39.001271 18639 heartbeater.cc:347] Connected to a master server at 127.30.78.126:43113
I20260809 06:34:39.001573 18639 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:39.002326 18639 heartbeater.cc:511] Master 127.30.78.126:43113 requested a full tablet report, sending...
I20260809 06:34:39.004238 18088 ts_manager.cc:194] Registered new tserver with Master: c315614ebae94b27890c4ef11887c597 (127.30.78.66:36731)
I20260809 06:34:39.006459 18088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:44499
W20260809 06:34:39.384114 18644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:39.384398 18644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:39.384558 18644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:39.391776 18644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:39.391888 18644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:39.392063 18644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:34:39.403615 18644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.78.84:60829/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:33303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=36617
--tserver_master_addrs=127.30.78.126:43113
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:39.404841 18644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:39.406322 18644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 06:34:39.412354 18397 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:39.412755 18397 heartbeater.cc:511] Master 127.30.78.126:43113 requested a full tablet report, sending...
I20260809 06:34:39.414021 18088 ts_manager.cc:194] Registered new tserver with Master: 130cae43957e4d9aad40b092a2d7af2d (127.30.78.65:34291)
I20260809 06:34:39.415253 18088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:58535
W20260809 06:34:39.427222 18651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:39.427549 18650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
Aug 09 06:34:39 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257278, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:39.434015 18644 server_base.cc:1034] running on GCE node
W20260809 06:34:39.434345 18657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:39.435029 18644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:39.436041 18644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:39.449275 18644 hybrid_clock.cc:648] HybridClock initialized: now 1786257279447224 us; error 2010 us; skew 500 ppm
I20260809 06:34:39.449774 18644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:39 dist-test-slave-cvwc krb5kdc[16462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257279, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:39.453912 18644 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:34:39.458582 18644 webserver.cc:460] Webserver started at http://127.30.78.67:36617/ using document root <none> and password file <none>
I20260809 06:34:39.459544 18644 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:39.459692 18644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 09 06:34:39 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257279, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:39.495679 18644 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.004s sys 0.004s
I20260809 06:34:39.500808 18669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:39.502549 18644 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:34:39.502799 18644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "17eda241af2047f49049505a7c949958"
format_stamp: "Formatted at 2026-08-09 06:34:36 on dist-test-slave-cvwc"
server_key: "28cb7505b1f8ce9c7b2dbfbab912ac63"
server_key_iv: "9ae36173628e4e1ff5f6a3088f85f7f0"
server_key_version: "kuduclusterkey@0"
I20260809 06:34:39.504228 18644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:39.536432 18644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:39.541922 18644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:39.542214 18644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:39.543412 18644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:39.545169 18644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:39.545300 18644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:39.545420 18644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:39.545500 18644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:39.594892 18644 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:33303
I20260809 06:34:39.594956 18855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:33303 every 8 connection(s)
I20260809 06:34:39.596781 18644 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:34:39.598179 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 18644
Aug 09 06:34:39 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257279, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:39.630014 18861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.599281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52734 (local address 127.30.78.126:43113)
0809 06:34:39.606899 (+ 7618us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:39.606905 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:39.606926 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:34:39.606992 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:39.606997 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:39.607080 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:39.607204 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:39.613832 (+ 6628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.615087 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.617109 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.618092 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.618366 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.621954 (+ 3588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:39.621961 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:39.621966 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:39.622009 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:39.625693 (+ 3684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:39.626593 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:39.626599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:39.626602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:39.626765 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:39.627245 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:39.627251 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:39.627254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:39.627850 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:39.628077 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:39.629376 (+ 1299us) server_negotiation.cc:299] Negotiation successful
0809 06:34:39.629612 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7487,"thread_start_us":7517,"threads_started":1}
I20260809 06:34:39.638264 18863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.608862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:50547 (local address 127.30.78.126:43113)
0809 06:34:39.616592 (+ 7730us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:39.616597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:39.619846 (+ 3249us) server_negotiation.cc:407] Connection header received
0809 06:34:39.619905 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:39.619910 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:39.620002 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:39.620113 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:39.622029 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.623281 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.625576 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.626271 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.626361 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.630702 (+ 4341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:39.630709 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:39.630713 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:39.630746 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:39.634836 (+ 4090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:39.635683 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:39.635689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:39.635692 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:39.635833 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:39.636295 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:39.636300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:39.636303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:39.636612 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:39.636742 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:39.637607 (+ 865us) server_negotiation.cc:299] Negotiation successful
0809 06:34:39.637849 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7623,"thread_start_us":7509,"threads_started":1}
I20260809 06:34:39.639964 18862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.608176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43113 (local address 127.30.78.67:50547)
0809 06:34:39.617014 (+ 8838us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:39.617068 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:39.619487 (+ 2419us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:39.620403 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:39.620415 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:39.621020 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:39.621802 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:39.621827 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.623476 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.623482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:39.625416 (+ 1934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:39.625431 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.626686 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.626693 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:39.626981 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.627606 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:39.627635 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:39.630419 (+ 2784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:39.634991 (+ 4572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:39.634999 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:39.635015 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:39.635545 (+ 530us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:39.635950 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:39.635955 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:39.635958 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:39.636171 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:39.636827 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:39.636835 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:39.637209 (+ 374us) client_negotiation.cc:769] Sending connection context
0809 06:34:39.637817 (+ 608us) client_negotiation.cc:240] Negotiation successful
0809 06:34:39.638433 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8580,"thread_start_us":8806,"threads_started":1}
I20260809 06:34:39.641448 18857 heartbeater.cc:347] Connected to a master server at 127.30.78.126:43113
I20260809 06:34:39.641798 18857 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:39.642603 18857 heartbeater.cc:511] Master 127.30.78.126:43113 requested a full tablet report, sending...
I20260809 06:34:39.644316 18088 ts_manager.cc:194] Registered new tserver with Master: 17eda241af2047f49049505a7c949958 (127.30.78.67:33303)
I20260809 06:34:39.645424 18088 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:50547
I20260809 06:34:39.649588 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:34:39.682770 18863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.658067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52738 (local address 127.30.78.126:43113)
0809 06:34:39.658234 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:39.658240 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:39.666306 (+ 8066us) server_negotiation.cc:407] Connection header received
0809 06:34:39.666510 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:39.666515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:39.666622 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:39.666730 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:39.668747 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.669799 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.671716 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.672330 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.672428 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.675975 (+ 3547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:39.675982 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:39.675988 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:39.676028 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:39.679322 (+ 3294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:39.680197 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:39.680203 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:39.680207 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:39.680361 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:39.680848 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:39.680853 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:39.680856 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:39.681212 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:39.681424 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:39.682175 (+ 751us) server_negotiation.cc:299] Negotiation successful
0809 06:34:39.682404 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:34:39.689424 18087 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52738:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:34:39.700688 18087 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 09 06:34:39 dist-test-slave-cvwc krb5kdc[16462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257278, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for HTTP/127.30.78.84@KRBTEST.COM
I20260809 06:34:39.750157 18889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.721685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36586 (local address 127.30.78.67:33303)
0809 06:34:39.734527 (+ 12842us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:39.734535 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:39.737752 (+ 3217us) server_negotiation.cc:407] Connection header received
0809 06:34:39.738106 (+ 354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:39.738114 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:39.738361 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:39.738533 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:39.739511 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.741023 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.747226 (+ 6203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.748597 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.748713 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.748953 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:39.749602 (+ 649us) server_negotiation.cc:299] Negotiation successful
0809 06:34:39.749811 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12676,"thread_start_us":12487,"threads_started":1}
I20260809 06:34:39.750882 18886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.721304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:33303 (local address 127.0.0.1:36586)
0809 06:34:39.737610 (+ 16306us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:39.737629 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:39.737870 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:39.738879 (+ 1009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:39.738883 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:39.738909 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:39.739316 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:39.739328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.741189 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.741193 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:39.747032 (+ 5839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:39.747049 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.749149 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.749155 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:39.749332 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.749386 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 06:34:39.750374 (+ 988us) client_negotiation.cc:240] Negotiation successful
0809 06:34:39.750568 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15447,"thread_start_us":5666,"threads_started":1}
I20260809 06:34:39.754874 18888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.719028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34291 (local address 127.0.0.1:51682)
0809 06:34:39.726240 (+ 7212us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:39.726302 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:39.726478 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:39.733657 (+ 7179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:39.733665 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:39.733695 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:39.734533 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:39.734550 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.736600 (+ 2050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.736605 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:39.748131 (+ 11526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:39.748147 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.754058 (+ 5911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.754065 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:39.754229 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.754262 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:34:39.754343 (+ 81us) client_negotiation.cc:240] Negotiation successful
0809 06:34:39.754479 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6950,"mutex_wait_us":2,"thread_start_us":14911,"threads_started":1}
I20260809 06:34:39.757097 18752 tablet_service.cc:1467] Processing CreateTablet for tablet 960aeb263a824bc98bb24aa5e710844b (DEFAULT_TABLE table=test-table [id=da26d042bdea4c76b5eefb8473f7df79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:34:39.758883 18752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960aeb263a824bc98bb24aa5e710844b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:39.761509 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.719673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51682 (local address 127.30.78.65:34291)
0809 06:34:39.730174 (+ 10501us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:39.730183 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:39.730213 (+ 30us) server_negotiation.cc:407] Connection header received
0809 06:34:39.733177 (+ 2964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:39.733183 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:39.733397 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:39.733580 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:39.734814 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.736398 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.751193 (+ 14795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.752659 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.752771 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.753027 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:39.760952 (+ 7925us) server_negotiation.cc:299] Negotiation successful
0809 06:34:39.761161 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10321,"thread_start_us":10155,"threads_started":1}
I20260809 06:34:39.765671 18294 tablet_service.cc:1467] Processing CreateTablet for tablet 960aeb263a824bc98bb24aa5e710844b (DEFAULT_TABLE table=test-table [id=da26d042bdea4c76b5eefb8473f7df79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:34:39.767277 18294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960aeb263a824bc98bb24aa5e710844b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:39.788228 18896 tablet_bootstrap.cc:492] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: Bootstrap starting.
I20260809 06:34:39.789110 18894 tablet_bootstrap.cc:492] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: Bootstrap starting.
I20260809 06:34:39.792665 18886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.737430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:36731 (local address 127.0.0.1:54484)
0809 06:34:39.751539 (+ 14109us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:39.751556 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:39.751646 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:39.774290 (+ 22644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:39.774297 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:39.774333 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:39.774518 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:39.774531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.782425 (+ 7894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.782433 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:39.784519 (+ 2086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:39.784540 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.791909 (+ 7369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.791916 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:39.792108 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.792145 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:34:39.792216 (+ 71us) client_negotiation.cc:240] Negotiation successful
0809 06:34:39.792390 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14022,"thread_start_us":22923,"threads_started":1}
I20260809 06:34:39.793565 18896 tablet_bootstrap.cc:654] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:39.794643 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:39.735036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54484 (local address 127.30.78.66:36731)
0809 06:34:39.765741 (+ 30705us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:39.765750 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:39.765782 (+ 32us) server_negotiation.cc:407] Connection header received
0809 06:34:39.765880 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:39.765888 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:39.766120 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:39.774725 (+ 8605us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:39.774976 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.776509 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.785117 (+ 8608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:39.786504 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:39.793213 (+ 6709us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:39.794075 (+ 862us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:39.794151 (+ 76us) server_negotiation.cc:299] Negotiation successful
0809 06:34:39.794338 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30515,"thread_start_us":30372,"threads_started":1}
I20260809 06:34:39.795140 18894 tablet_bootstrap.cc:654] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:39.795356 18896 log.cc:824] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:39.796372 18894 log.cc:824] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:39.799767 18535 tablet_service.cc:1467] Processing CreateTablet for tablet 960aeb263a824bc98bb24aa5e710844b (DEFAULT_TABLE table=test-table [id=da26d042bdea4c76b5eefb8473f7df79]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:34:39.802402 18535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 960aeb263a824bc98bb24aa5e710844b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:39.825217 18900 tablet_bootstrap.cc:492] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: Bootstrap starting.
I20260809 06:34:39.827098 18896 tablet_bootstrap.cc:492] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: No bootstrap required, opened a new log
I20260809 06:34:39.827473 18896 ts_tablet_manager.cc:1397] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: Time spent bootstrapping tablet: real 0.042s user 0.011s sys 0.003s
I20260809 06:34:39.830180 18894 tablet_bootstrap.cc:492] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: No bootstrap required, opened a new log
I20260809 06:34:39.830479 18894 ts_tablet_manager.cc:1397] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: Time spent bootstrapping tablet: real 0.042s user 0.007s sys 0.013s
I20260809 06:34:39.832028 18900 tablet_bootstrap.cc:654] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:39.833333 18900 log.cc:824] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:39.839759 18896 raft_consensus.cc:348] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } }
I20260809 06:34:39.840456 18896 raft_consensus.cc:374] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:39.840619 18896 raft_consensus.cc:729] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 130cae43957e4d9aad40b092a2d7af2d, State: Initialized, Role: FOLLOWER
I20260809 06:34:39.840449 18894 raft_consensus.cc:348] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } }
I20260809 06:34:39.840957 18894 raft_consensus.cc:374] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:39.841076 18894 raft_consensus.cc:729] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17eda241af2047f49049505a7c949958, State: Initialized, Role: FOLLOWER
I20260809 06:34:39.841523 18896 consensus_queue.cc:260] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } }
I20260809 06:34:39.841682 18894 consensus_queue.cc:260] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } }
I20260809 06:34:39.848986 18857 heartbeater.cc:503] Master 127.30.78.126:43113 was elected leader, sending a full tablet report...
I20260809 06:34:39.850116 18894 ts_tablet_manager.cc:1428] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: Time spent starting tablet: real 0.020s user 0.009s sys 0.010s
I20260809 06:34:39.851574 18896 ts_tablet_manager.cc:1428] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: Time spent starting tablet: real 0.024s user 0.010s sys 0.009s
I20260809 06:34:39.853173 18397 heartbeater.cc:503] Master 127.30.78.126:43113 was elected leader, sending a full tablet report...
I20260809 06:34:39.860893 18900 tablet_bootstrap.cc:492] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: No bootstrap required, opened a new log
I20260809 06:34:39.861348 18900 ts_tablet_manager.cc:1397] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.004s
W20260809 06:34:39.866597 18859 tablet.cc:2369] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:34:39.872985 18900 raft_consensus.cc:348] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } }
I20260809 06:34:39.873567 18900 raft_consensus.cc:374] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:39.873708 18900 raft_consensus.cc:729] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c315614ebae94b27890c4ef11887c597, State: Initialized, Role: FOLLOWER
I20260809 06:34:39.874437 18900 consensus_queue.cc:260] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } }
I20260809 06:34:39.876374 18900 ts_tablet_manager.cc:1428] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: Time spent starting tablet: real 0.015s user 0.012s sys 0.000s
I20260809 06:34:39.876893 18639 heartbeater.cc:503] Master 127.30.78.126:43113 was elected leader, sending a full tablet report...
W20260809 06:34:39.878712 18399 tablet.cc:2369] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:34:39.955209 18641 tablet.cc:2369] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:34:40.098269 18905 raft_consensus.cc:482] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:34:40.098610 18905 raft_consensus.cc:504] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } }
I20260809 06:34:40.100374 18905 leader_election.cc:288] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 130cae43957e4d9aad40b092a2d7af2d (127.30.78.65:34291), 17eda241af2047f49049505a7c949958 (127.30.78.67:33303)
I20260809 06:34:40.106952 18889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:40.100868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:53605 (local address 127.30.78.67:33303)
0809 06:34:40.101060 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:40.101067 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:40.101752 (+ 685us) server_negotiation.cc:407] Connection header received
0809 06:34:40.101923 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:40.101926 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:40.101986 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:40.102061 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:40.102703 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.103386 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.105273 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.106048 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.106201 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:40.106278 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:40.106562 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 06:34:40.106677 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:34:40.106977 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:40.100756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:39801 (local address 127.30.78.65:34291)
0809 06:34:40.100992 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:40.100999 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:40.101655 (+ 656us) server_negotiation.cc:407] Connection header received
0809 06:34:40.101886 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:40.101890 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:40.101956 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:40.102033 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:40.102645 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.103351 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.105281 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.106061 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.106211 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:40.106284 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:40.106609 (+ 325us) server_negotiation.cc:299] Negotiation successful
0809 06:34:40.106736 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:34:40.107090 18915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:40.100777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:33303 (local address 127.30.78.66:53605)
0809 06:34:40.101614 (+ 837us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:40.101628 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:40.101789 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:40.102086 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:40.102090 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:40.102113 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:40.102550 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:40.102559 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.103508 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.103511 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:40.105124 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:40.105137 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.106275 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.106282 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:40.106414 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:40.106440 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 06:34:40.106522 (+ 82us) client_negotiation.cc:240] Negotiation successful
0809 06:34:40.106663 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":68,"thread_start_us":406,"threads_started":1}
I20260809 06:34:40.107122 18917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:40.100626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34291 (local address 127.30.78.66:39801)
0809 06:34:40.101540 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:40.101556 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:40.101707 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:40.102067 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:40.102072 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:40.102095 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:40.102490 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:40.102502 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.103484 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.103489 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:40.105123 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:40.105135 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.106326 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.106333 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:40.106469 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:40.106490 (+ 21us) client_negotiation.cc:769] Sending connection context
0809 06:34:40.106569 (+ 79us) client_negotiation.cc:240] Negotiation successful
0809 06:34:40.106715 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"mutex_wait_us":101,"thread_start_us":652,"threads_started":1}
I20260809 06:34:40.108093 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960aeb263a824bc98bb24aa5e710844b" candidate_uuid: "c315614ebae94b27890c4ef11887c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17eda241af2047f49049505a7c949958" is_pre_election: true
I20260809 06:34:40.108096 18320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960aeb263a824bc98bb24aa5e710844b" candidate_uuid: "c315614ebae94b27890c4ef11887c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130cae43957e4d9aad40b092a2d7af2d" is_pre_election: true
I20260809 06:34:40.108661 18782 raft_consensus.cc:2454] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c315614ebae94b27890c4ef11887c597 in term 0.
I20260809 06:34:40.108685 18320 raft_consensus.cc:2454] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c315614ebae94b27890c4ef11887c597 in term 0.
I20260809 06:34:40.109398 18459 leader_election.cc:302] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 130cae43957e4d9aad40b092a2d7af2d, 17eda241af2047f49049505a7c949958, c315614ebae94b27890c4ef11887c597; no voters:
I20260809 06:34:40.109827 18905 raft_consensus.cc:2781] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:34:40.109977 18905 raft_consensus.cc:482] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:34:40.110080 18905 raft_consensus.cc:3037] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:40.112244 18905 raft_consensus.cc:504] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } }
I20260809 06:34:40.112860 18905 leader_election.cc:288] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [CANDIDATE]: Term 1 election: Requested vote from peers 130cae43957e4d9aad40b092a2d7af2d (127.30.78.65:34291), 17eda241af2047f49049505a7c949958 (127.30.78.67:33303)
I20260809 06:34:40.113261 18320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960aeb263a824bc98bb24aa5e710844b" candidate_uuid: "c315614ebae94b27890c4ef11887c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "130cae43957e4d9aad40b092a2d7af2d"
I20260809 06:34:40.113384 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "960aeb263a824bc98bb24aa5e710844b" candidate_uuid: "c315614ebae94b27890c4ef11887c597" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17eda241af2047f49049505a7c949958"
I20260809 06:34:40.113446 18320 raft_consensus.cc:3037] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:40.113585 18782 raft_consensus.cc:3037] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:40.115604 18320 raft_consensus.cc:2454] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c315614ebae94b27890c4ef11887c597 in term 1.
I20260809 06:34:40.115732 18782 raft_consensus.cc:2454] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c315614ebae94b27890c4ef11887c597 in term 1.
I20260809 06:34:40.115969 18459 leader_election.cc:302] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 130cae43957e4d9aad40b092a2d7af2d, c315614ebae94b27890c4ef11887c597; no voters:
I20260809 06:34:40.116240 18905 raft_consensus.cc:2781] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:34:40.116657 18905 raft_consensus.cc:686] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 1 LEADER]: Becoming Leader. State: Replica: c315614ebae94b27890c4ef11887c597, State: Running, Role: LEADER
I20260809 06:34:40.117079 18905 consensus_queue.cc:237] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } }
I20260809 06:34:40.121688 18087 catalog_manager.cc:5495] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 reported cstate change: term changed from 0 to 1, leader changed from <none> to c315614ebae94b27890c4ef11887c597 (127.30.78.66). New cstate: current_term: 1 leader_uuid: "c315614ebae94b27890c4ef11887c597" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c315614ebae94b27890c4ef11887c597" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 36731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 } health_report { overall_health: UNKNOWN } } }
I20260809 06:34:40.144982 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:40.139881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54486 (local address 127.30.78.66:36731)
0809 06:34:40.140077 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:40.140083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:40.140100 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:34:40.140178 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:40.140181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:40.140257 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:40.140390 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:34:40.140768 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.141468 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.142926 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.143322 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.143439 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:40.143889 (+ 450us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:34:40.144379 (+ 490us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:34:40.144506 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:40.144614 (+ 108us) server_negotiation.cc:299] Negotiation successful
0809 06:34:40.144745 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:34:40.152738 18782 raft_consensus.cc:1261] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [term 1 FOLLOWER]: Refusing update from remote peer c315614ebae94b27890c4ef11887c597: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:34:40.152738 18320 raft_consensus.cc:1261] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [term 1 FOLLOWER]: Refusing update from remote peer c315614ebae94b27890c4ef11887c597: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:34:40.153679 18918 consensus_queue.cc:1035] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "130cae43957e4d9aad40b092a2d7af2d" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:34:40.154016 18905 consensus_queue.cc:1035] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17eda241af2047f49049505a7c949958" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 33303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:34:40.166446 18923 mvcc.cc:205] Tried to move back new op lower bound from 7316509819495825408 to 7316509819363246080. Current Snapshot: MvccSnapshot[applied={T|T < 7316509819495825408}]
I20260809 06:34:40.177909 18087 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:34:40.178138 18087 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:34:40.181182 18087 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10d0388ea495445ebc9ac3c9f9429ab3: Sending DeleteTablet for 3 replicas of tablet 960aeb263a824bc98bb24aa5e710844b
I20260809 06:34:40.182225 18752 tablet_service.cc:1514] Processing DeleteTablet for tablet 960aeb263a824bc98bb24aa5e710844b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:34:40 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:36586
I20260809 06:34:40.182294 18535 tablet_service.cc:1514] Processing DeleteTablet for tablet 960aeb263a824bc98bb24aa5e710844b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:34:40 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:54484
I20260809 06:34:40.182482 18294 tablet_service.cc:1514] Processing DeleteTablet for tablet 960aeb263a824bc98bb24aa5e710844b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:34:40 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:51682
I20260809 06:34:40.183099 18937 tablet_replica.cc:330] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: stopping tablet replica
I20260809 06:34:40.183513 18937 raft_consensus.cc:2229] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:34:40.183956 18937 raft_consensus.cc:2258] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:34:40.184764 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 18148
I20260809 06:34:40.185963 18937 ts_tablet_manager.cc:1905] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:34:40.193106 18937 ts_tablet_manager.cc:1918] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:34:40.193277 18937 log.cc:1196] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/960aeb263a824bc98bb24aa5e710844b
I20260809 06:34:40.193862 18937 ts_tablet_manager.cc:1939] T 960aeb263a824bc98bb24aa5e710844b P 17eda241af2047f49049505a7c949958: Deleting consensus metadata
I20260809 06:34:40.195638 18062 catalog_manager.cc:4841] TS 17eda241af2047f49049505a7c949958 (127.30.78.67:33303): tablet 960aeb263a824bc98bb24aa5e710844b (table test-table [id=da26d042bdea4c76b5eefb8473f7df79]) successfully deleted
I20260809 06:34:40.202457 18938 tablet_replica.cc:330] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: stopping tablet replica
I20260809 06:34:40.202929 18938 raft_consensus.cc:2229] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:34:40.203642 18938 raft_consensus.cc:2258] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:34:40.205999 18938 ts_tablet_manager.cc:1905] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:34:40.209472 18939 tablet_replica.cc:330] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: stopping tablet replica
I20260809 06:34:40.209956 18939 raft_consensus.cc:2229] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:34:40.210517 18939 raft_consensus.cc:2258] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:34:40.212769 18939 ts_tablet_manager.cc:1905] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:34:40.215075 18938 ts_tablet_manager.cc:1918] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:34:40.215245 18938 log.cc:1196] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/960aeb263a824bc98bb24aa5e710844b
I20260809 06:34:40.215893 18938 ts_tablet_manager.cc:1939] T 960aeb263a824bc98bb24aa5e710844b P c315614ebae94b27890c4ef11887c597: Deleting consensus metadata
I20260809 06:34:40.217993 18065 catalog_manager.cc:4841] TS c315614ebae94b27890c4ef11887c597 (127.30.78.66:36731): tablet 960aeb263a824bc98bb24aa5e710844b (table test-table [id=da26d042bdea4c76b5eefb8473f7df79]) successfully deleted
I20260809 06:34:40.218268 18939 ts_tablet_manager.cc:1918] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:34:40.218433 18939 log.cc:1196] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/960aeb263a824bc98bb24aa5e710844b
I20260809 06:34:40.218976 18939 ts_tablet_manager.cc:1939] T 960aeb263a824bc98bb24aa5e710844b P 130cae43957e4d9aad40b092a2d7af2d: Deleting consensus metadata
I20260809 06:34:40.220386 18065 catalog_manager.cc:4841] TS 130cae43957e4d9aad40b092a2d7af2d (127.30.78.65:34291): tablet 960aeb263a824bc98bb24aa5e710844b (table test-table [id=da26d042bdea4c76b5eefb8473f7df79]) successfully deleted
I20260809 06:34:40.225566 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:40.186072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51686 (local address 127.30.78.65:34291)
0809 06:34:40.186256 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:40.186263 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:40.204699 (+ 18436us) server_negotiation.cc:407] Connection header received
0809 06:34:40.204989 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:40.204995 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:40.205080 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:40.205156 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:40.207322 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.208579 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.210609 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.211234 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.211331 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:40.218973 (+ 7642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:40.218989 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:40.219006 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:40.219048 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:40.222850 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:40.223512 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:40.223521 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:40.223525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:40.223698 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:40.224031 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:40.224036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:40.224040 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:40.224482 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:40.224787 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:40.224950 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 06:34:40.225163 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:34:40.226297 18388 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:40.314690 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 18148
I20260809 06:34:40.338546 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 18403
I20260809 06:34:40.354218 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:40.339553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54490 (local address 127.30.78.66:36731)
0809 06:34:40.339795 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:40.339802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:40.339824 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:34:40.339896 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:40.339902 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:40.339989 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:40.340102 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:40.341419 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.342688 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.343929 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.344588 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.344710 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:40.347510 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:40.347528 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:40.347549 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:40.347599 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:40.351457 (+ 3858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:40.352123 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:40.352133 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:40.352136 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:40.352306 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:40.352636 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:40.352641 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:40.352644 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:40.353106 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:40.353441 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:40.353601 (+ 160us) server_negotiation.cc:299] Negotiation successful
0809 06:34:40.353843 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260809 06:34:40.354998 18630 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:40.470638 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 18403
I20260809 06:34:40.493978 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 18644
I20260809 06:34:40.506172 18889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:40.494717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36592 (local address 127.30.78.67:33303)
0809 06:34:40.494877 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:40.494881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:40.494899 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:34:40.495048 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:40.495052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:40.495116 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:40.495198 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:40.496518 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.497236 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.498427 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:40.498838 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:40.498936 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:40.501284 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:40.501296 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:40.501311 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:40.501344 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:40.503934 (+ 2590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:40.504549 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:40.504555 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:40.504558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:40.504694 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:40.504976 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:40.504979 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:40.504981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:40.505309 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:40.505514 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:40.505704 (+ 190us) server_negotiation.cc:299] Negotiation successful
0809 06:34:40.505900 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:34:40.506778 18848 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:40.591961 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 18644
I20260809 06:34:40.613744 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 18040
I20260809 06:34:40.614967 18138 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:40.725003 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 18040
I20260809 06:34:40.751598 31033 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260809 06:34:41.095682 31033 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260809 06:34:41.095935 31033 mini_ranger.cc:66] Stopping Ranger...
I20260809 06:34:41.439576 31033 mini_ranger.cc:68] Stopped Ranger
2026-08-09 06:34:41.439 UTC [16506] LOG: received smart shutdown request
2026-08-09 06:34:41.442 UTC [16506] LOG: background worker "logical replication launcher" (PID 16519) exited with exit code 1
2026-08-09 06:34:41.442 UTC [16510] LOG: shutting down
2026-08-09 06:34:41.576 UTC [16506] LOG: database system is shut down
2026-08-09T06:34:41Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50444 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:34:41 dist-test-slave-cvwc krb5kdc[18959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:34:41 dist-test-slave-cvwc krb5kdc[18959](info): set up 2 sockets
Aug 09 06:34:41 dist-test-slave-cvwc krb5kdc[18959](info): commencing operation
krb5kdc: starting...
W20260809 06:34:42.884775 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:34:43 dist-test-slave-cvwc krb5kdc[18959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:34:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:34:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:34:43.119397 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:34231
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:34231,127.30.78.125:37711,127.30.78.124:35101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:43.436203 18983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:43.436450 18983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:43.436576 18983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:43.443393 18983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:34:43.443485 18983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:43.443554 18983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:43.443626 18983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:34:43.443686 18983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:34:43.452787 18983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:34231,127.30.78.125:37711,127.30.78.124:35101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:34231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:43.453948 18983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:43.455147 18983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:43.466038 18991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:43.466118 18994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:43.466089 18997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:43.467065 18983 server_base.cc:1034] running on GCE node
I20260809 06:34:43.467821 18983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:43.469038 18983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:43.470250 18983 hybrid_clock.cc:648] HybridClock initialized: now 1786257283470201 us; error 36 us; skew 500 ppm
I20260809 06:34:43.470546 18983 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:43 dist-test-slave-cvwc krb5kdc[18959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:43.473448 18983 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:34:43.474879 18983 webserver.cc:460] Webserver started at http://127.30.78.126:34323/ using document root <none> and password file <none>
I20260809 06:34:43.475486 18983 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:43.475584 18983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:43.475841 18983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:34:43.478729 18983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "5c5e9c066d724127b8e41d8905ec21cd"
format_stamp: "Formatted at 2026-08-09 06:34:43 on dist-test-slave-cvwc"
server_key: "fa45183f1994823d6a1009e539e532b6"
server_key_iv: "9d53b3396b4effdef3f229d06afd9726"
server_key_version: "encryptionkey@0"
I20260809 06:34:43.479467 18983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "5c5e9c066d724127b8e41d8905ec21cd"
format_stamp: "Formatted at 2026-08-09 06:34:43 on dist-test-slave-cvwc"
server_key: "fa45183f1994823d6a1009e539e532b6"
server_key_iv: "9d53b3396b4effdef3f229d06afd9726"
server_key_version: "encryptionkey@0"
I20260809 06:34:43.484244 18983 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:34:43.487495 19009 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:43.488732 18983 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:34:43.488874 18983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "5c5e9c066d724127b8e41d8905ec21cd"
format_stamp: "Formatted at 2026-08-09 06:34:43 on dist-test-slave-cvwc"
server_key: "fa45183f1994823d6a1009e539e532b6"
server_key_iv: "9d53b3396b4effdef3f229d06afd9726"
server_key_version: "encryptionkey@0"
I20260809 06:34:43.489040 18983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:43.521435 18983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:43.525400 18983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:43.525619 18983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:43.542306 18983 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:34231
I20260809 06:34:43.542348 19098 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:34231 every 8 connection(s)
I20260809 06:34:43.543505 18983 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:34:43.546835 19099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:43.548033 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 18983
I20260809 06:34:43.548239 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:34:43.548857 31033 external_mini_cluster.cc:1428] Setting key d06f321533bea817403a23cf13cf189c
I20260809 06:34:43.553000 19099 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:34:43 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.78.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.125@KRBTEST.COM" created.
I20260809 06:34:43.573206 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.555753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40370 (local address 127.30.78.126:34231)
0809 06:34:43.557323 (+ 1570us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:43.557331 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:43.557380 (+ 49us) server_negotiation.cc:407] Connection header received
0809 06:34:43.558832 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:43.558838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:43.559053 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:43.559228 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:43.560394 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:43.561543 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:43.562877 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:43.563379 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:43.563542 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:43.566569 (+ 3027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:43.566576 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:43.566587 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:43.566619 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:43.569143 (+ 2524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:43.569796 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:43.569802 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:43.569804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:43.569955 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:43.570310 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:43.570314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:43.570316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:43.570786 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:43.570977 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:43.571539 (+ 562us) server_negotiation.cc:299] Negotiation successful
0809 06:34:43.571795 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1370,"spinlock_wait_cycles":15104,"thread_start_us":1160,"threads_started":1}
I20260809 06:34:43.573237 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.555751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:34231 (local address 127.0.0.1:40370)
0809 06:34:43.556521 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.556566 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:43.558513 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:43.559263 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:43.559270 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:43.559904 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:43.560208 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:43.560224 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:43.561690 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:43.561694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:43.562740 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:43.562752 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:43.563599 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:43.563606 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:43.563764 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:43.564330 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:43.564351 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:43.566361 (+ 2010us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:43.569256 (+ 2895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:43.569266 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:43.569278 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:43.569652 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:43.570055 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:43.570060 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:43.570064 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:43.570206 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:43.570919 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:43.570927 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:43.571136 (+ 209us) client_negotiation.cc:769] Sending connection context
0809 06:34:43.571392 (+ 256us) client_negotiation.cc:240] Negotiation successful
0809 06:34:43.571946 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"mutex_wait_us":134,"thread_start_us":336,"threads_started":1}
I20260809 06:34:43.576180 19099 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:34:43.577190 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.576819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47842)
0809 06:34:43.576984 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.577082 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260809 06:34:43.577476 19014 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
I20260809 06:34:43.579026 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.578682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47844)
0809 06:34:43.578816 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.578886 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 06:34:43.579206 19099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:37711: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab.
Entry for principal kudu/127.30.78.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab.
I20260809 06:34:43.601101 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.125:37711
--webserver_interface=127.30.78.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab
--principal=kudu/127.30.78.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:34231,127.30.78.125:37711,127.30.78.124:35101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:34:43.628505 19099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } attempt: 1
I20260809 06:34:43.629658 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.629158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47846)
0809 06:34:43.629356 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.629506 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 06:34:43.630652 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.630277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47854)
0809 06:34:43.630425 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.630507 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 06:34:43.630849 19099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:37711: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
I20260809 06:34:43.699097 19099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } attempt: 2
I20260809 06:34:43.700313 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.699749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47862)
0809 06:34:43.700007 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.700121 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 06:34:43.701329 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.700918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47866)
0809 06:34:43.701072 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.701156 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 06:34:43.701522 19099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:37711: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
I20260809 06:34:43.792747 19099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } attempt: 3
I20260809 06:34:43.793938 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.793374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47872)
0809 06:34:43.793597 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.793770 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 06:34:43.794991 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.794580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47874)
0809 06:34:43.794732 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.794820 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 06:34:43.795208 19099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:37711: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
W20260809 06:34:43.917378 19110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:43.917632 19110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:43.917742 19110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:43.924594 19110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:34:43.924686 19110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:43.924738 19110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:43.924826 19110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:34:43.924880 19110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:34:43.934250 19110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:34231,127.30.78.125:37711,127.30.78.124:35101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab
--principal=kudu/127.30.78.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.125:37711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.78.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:43.935432 19110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:43.936635 19110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 06:34:43.938438 19099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } attempt: 4
I20260809 06:34:43.939652 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.939010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47882)
0809 06:34:43.939362 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.939478 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
I20260809 06:34:43.940665 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:43.940324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47896)
0809 06:34:43.940453 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:43.940545 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 06:34:43.940873 19099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:37711: Network error: Client connection negotiation failed: client connection to 127.30.78.125:37711: connect: Connection refused (error 111)
W20260809 06:34:43.947886 19115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:43.947849 19116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:43.947911 19118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:43.948696 19110 server_base.cc:1034] running on GCE node
I20260809 06:34:43.949409 19110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:43.950675 19110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:43.951861 19110 hybrid_clock.cc:648] HybridClock initialized: now 1786257283951819 us; error 34 us; skew 500 ppm
I20260809 06:34:43.952162 19110 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:43 dist-test-slave-cvwc krb5kdc[18959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:43.955083 19110 init.cc:377] Logged in from keytab as kudu/127.30.78.125@KRBTEST.COM (short username kudu)
I20260809 06:34:43.956441 19110 webserver.cc:460] Webserver started at http://127.30.78.125:39343/ using document root <none> and password file <none>
I20260809 06:34:43.957037 19110 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:43.957144 19110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:43.957422 19110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:34:43.960203 19110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/data/instance:
uuid: "c25a0c24f39548869bf958e0242eb0eb"
format_stamp: "Formatted at 2026-08-09 06:34:43 on dist-test-slave-cvwc"
server_key: "3f0d8e6a5a5cdc47d7f7b0458d1e3f20"
server_key_iv: "5d27e687d098db0a74e0c3c03d320b6f"
server_key_version: "encryptionkey@0"
I20260809 06:34:43.960956 19110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/wal/instance:
uuid: "c25a0c24f39548869bf958e0242eb0eb"
format_stamp: "Formatted at 2026-08-09 06:34:43 on dist-test-slave-cvwc"
server_key: "3f0d8e6a5a5cdc47d7f7b0458d1e3f20"
server_key_iv: "5d27e687d098db0a74e0c3c03d320b6f"
server_key_version: "encryptionkey@0"
I20260809 06:34:43.965684 19110 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:34:43.968892 19128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:43.970150 19110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:34:43.970289 19110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/wal
uuid: "c25a0c24f39548869bf958e0242eb0eb"
format_stamp: "Formatted at 2026-08-09 06:34:43 on dist-test-slave-cvwc"
server_key: "3f0d8e6a5a5cdc47d7f7b0458d1e3f20"
server_key_iv: "5d27e687d098db0a74e0c3c03d320b6f"
server_key_version: "encryptionkey@0"
I20260809 06:34:43.970470 19110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:43.992004 19110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:43.996018 19110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:43.996243 19110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:44.012494 19110 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.125:37711
I20260809 06:34:44.012534 19211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.125:37711 every 8 connection(s)
I20260809 06:34:44.013677 19110 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
I20260809 06:34:44.017006 19213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:44.019771 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 19110
I20260809 06:34:44.019937 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-1/wal/instance
I20260809 06:34:44.020346 31033 external_mini_cluster.cc:1428] Setting key 1527a4407076f66dfddd9a6fa734150a
I20260809 06:34:44.023082 19213 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:44.041452 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.025965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40386 (local address 127.30.78.126:34231)
0809 06:34:44.026157 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.026163 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.026761 (+ 598us) server_negotiation.cc:407] Connection header received
0809 06:34:44.028540 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.028546 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.028628 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.028741 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.030327 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.031168 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.032575 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.032989 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.033099 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.036223 (+ 3124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.036228 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.036231 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.036264 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.038718 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.039366 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.039371 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.039375 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.039489 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.039863 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.039874 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.039876 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.040142 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.040286 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.040927 (+ 641us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.041147 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:34:44.042295 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.025760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:34231 (local address 127.0.0.1:40386)
0809 06:34:44.026591 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.026640 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:44.028273 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:44.028900 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:44.028907 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:44.029384 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:44.030126 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.030149 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.031292 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.031296 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.032437 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.032449 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.033199 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.033208 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.033409 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.034022 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:44.034047 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:44.036019 (+ 1972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:44.038842 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.038850 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.038863 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.039245 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.039588 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.039593 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.039597 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.039752 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.040264 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:44.040271 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:44.040574 (+ 303us) client_negotiation.cc:769] Sending connection context
0809 06:34:44.040797 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 06:34:44.041217 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":378,"threads_started":1}
WARNING: no policy specified for kudu/127.30.78.124@KRBTEST.COM; defaulting to no policy
I20260809 06:34:44.043825 19213 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.124@KRBTEST.COM" created.
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:34:44.057816 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.044441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47904)
0809 06:34:44.044587 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.044604 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:44.044694 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:44.045827 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:44.045831 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:44.046145 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:44.046270 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.046277 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.048000 (+ 1723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.048003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.048782 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.048792 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.049807 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.049811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.049981 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.050445 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:44.050460 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:44.052232 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:44.055357 (+ 3125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.055362 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.055367 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.055820 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.056170 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.056174 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.056177 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.056356 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.056911 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:44.056915 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:44.057041 (+ 126us) client_negotiation.cc:769] Sending connection context
0809 06:34:44.057178 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 06:34:44.057450 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 06:34:44.057911 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.044785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47904 (local address 127.30.78.125:37711)
0809 06:34:44.045399 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.045404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.045428 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:34:44.045469 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.045475 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.045660 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.045827 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.046420 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.047878 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.048916 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.049648 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.049791 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.052445 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.052458 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.052474 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.052514 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.055226 (+ 2712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.055935 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.055940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.055943 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.056060 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.056455 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.056458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.056460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.056761 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.056910 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.057265 (+ 355us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.057545 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":104,"server-negotiator.queue_time_us":450,"thread_start_us":320,"threads_started":1}
I20260809 06:34:44.060145 19213 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:34:44.061293 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.060789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54120)
0809 06:34:44.060977 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.061108 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 06:34:44.061548 19131 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
I20260809 06:34:44.063012 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.062717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54136)
0809 06:34:44.062843 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.062921 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 06:34:44.063215 19213 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:35101: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab.
Entry for principal kudu/127.30.78.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab.
I20260809 06:34:44.074738 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.124:35101
--webserver_interface=127.30.78.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab
--principal=kudu/127.30.78.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:34231,127.30.78.125:37711,127.30.78.124:35101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:34:44.112496 19213 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } attempt: 1
I20260809 06:34:44.113617 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.113177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54144)
0809 06:34:44.113361 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.113466 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 06:34:44.114571 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.114248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54160)
0809 06:34:44.114395 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.114463 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 06:34:44.114766 19213 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:35101: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
I20260809 06:34:44.182948 19213 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } attempt: 2
I20260809 06:34:44.184031 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.183607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54166)
0809 06:34:44.183781 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.183872 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 06:34:44.185046 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.184724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54172)
0809 06:34:44.184851 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.184932 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 06:34:44.185271 19213 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:35101: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
I20260809 06:34:44.240103 19099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } attempt: 5
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:34:44.252916 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.240858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47910)
0809 06:34:44.241084 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.241106 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:44.241253 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:44.241601 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:44.241605 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:44.242052 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:44.242239 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.242249 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.243271 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.243277 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.244148 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.244161 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.244898 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.244903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.245080 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.245667 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:44.245684 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:44.247873 (+ 2189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:44.250653 (+ 2780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.250659 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.250663 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.251021 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.251375 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.251380 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.251383 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.251515 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.252007 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:44.252012 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:44.252157 (+ 145us) client_negotiation.cc:769] Sending connection context
0809 06:34:44.252288 (+ 131us) client_negotiation.cc:240] Negotiation successful
0809 06:34:44.252545 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 06:34:44.252944 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.240925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47910 (local address 127.30.78.125:37711)
0809 06:34:44.241110 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.241116 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.241185 (+ 69us) server_negotiation.cc:407] Connection header received
0809 06:34:44.241389 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.241393 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.241459 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.241543 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.242414 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.243141 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.244294 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.244748 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.244859 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.248068 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.248072 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.248076 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.248107 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.250534 (+ 2427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.251144 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.251148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.251150 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.251270 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.251617 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.251621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.251623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.251894 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.252022 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.252425 (+ 403us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.252630 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260809 06:34:44.254163 19099 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:34:44.255154 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.254796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54182)
0809 06:34:44.254957 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.255032 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 06:34:44.256036 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.255734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54188)
0809 06:34:44.255877 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.255944 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 06:34:44.256218 19099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:35101: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
I20260809 06:34:44.276450 19213 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } attempt: 3
I20260809 06:34:44.277405 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.276984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54194)
0809 06:34:44.277158 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.277246 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260809 06:34:44.278640 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.278166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54200)
0809 06:34:44.278420 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.278528 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
W20260809 06:34:44.278861 19213 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:35101: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
I20260809 06:34:44.307423 19099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } attempt: 1
I20260809 06:34:44.308486 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.308030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54204)
0809 06:34:44.308201 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.308310 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 06:34:44.309368 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.309057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54220)
0809 06:34:44.309196 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.309263 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 06:34:44.309564 19099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:35101: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
I20260809 06:34:44.377764 19099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } attempt: 2
I20260809 06:34:44.378819 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.378325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54236)
0809 06:34:44.378554 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.378655 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 06:34:44.379698 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.379400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54244)
0809 06:34:44.379533 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.379598 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 06:34:44.379885 19099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:35101: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
W20260809 06:34:44.397845 19226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:44.398108 19226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:44.398236 19226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:44.405071 19226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:34:44.405169 19226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:44.405246 19226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:44.405323 19226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:34:44.405393 19226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:34:44.414561 19226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:34231,127.30.78.125:37711,127.30.78.124:35101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab
--principal=kudu/127.30.78.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.124:35101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.78.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:44.415787 19226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:44.416966 19226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260809 06:34:44.422062 19213 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } attempt: 4
I20260809 06:34:44.423265 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.422684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54250)
0809 06:34:44.422967 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.423072 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260809 06:34:44.424257 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.423945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54258)
0809 06:34:44.424075 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.424145 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 06:34:44.424459 19213 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:35101: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
W20260809 06:34:44.428105 19246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:44.428153 19242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:44.428560 19240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:44.428897 19226 server_base.cc:1034] running on GCE node
I20260809 06:34:44.429651 19226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:44.430986 19226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:44.432181 19226 hybrid_clock.cc:648] HybridClock initialized: now 1786257284432125 us; error 47 us; skew 500 ppm
I20260809 06:34:44.432497 19226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257284, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:44.435387 19226 init.cc:377] Logged in from keytab as kudu/127.30.78.124@KRBTEST.COM (short username kudu)
I20260809 06:34:44.436681 19226 webserver.cc:460] Webserver started at http://127.30.78.124:35795/ using document root <none> and password file <none>
I20260809 06:34:44.437296 19226 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:44.437417 19226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:44.437688 19226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:34:44.440481 19226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/data/instance:
uuid: "d41427478a7a4e559ccdf4a76ea14b43"
format_stamp: "Formatted at 2026-08-09 06:34:44 on dist-test-slave-cvwc"
server_key: "31dcbcddc22d691c30990a1cefdfa108"
server_key_iv: "bfae1128958e3a95c210a73ebe3ab34c"
server_key_version: "encryptionkey@0"
I20260809 06:34:44.441247 19226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/wal/instance:
uuid: "d41427478a7a4e559ccdf4a76ea14b43"
format_stamp: "Formatted at 2026-08-09 06:34:44 on dist-test-slave-cvwc"
server_key: "31dcbcddc22d691c30990a1cefdfa108"
server_key_iv: "bfae1128958e3a95c210a73ebe3ab34c"
server_key_version: "encryptionkey@0"
I20260809 06:34:44.445952 19226 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.002s
I20260809 06:34:44.449023 19257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:44.450213 19226 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:34:44.450364 19226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/wal
uuid: "d41427478a7a4e559ccdf4a76ea14b43"
format_stamp: "Formatted at 2026-08-09 06:34:44 on dist-test-slave-cvwc"
server_key: "31dcbcddc22d691c30990a1cefdfa108"
server_key_iv: "bfae1128958e3a95c210a73ebe3ab34c"
server_key_version: "encryptionkey@0"
I20260809 06:34:44.450539 19226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:44.486083 19099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } attempt: 3
I20260809 06:34:44.487169 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.486718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54262)
0809 06:34:44.486932 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.487020 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 06:34:44.488139 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.487778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54274)
0809 06:34:44.487959 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.488037 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260809 06:34:44.488355 19099 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:35101: Network error: Client connection negotiation failed: client connection to 127.30.78.124:35101: connect: Connection refused (error 111)
I20260809 06:34:44.493486 19226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:44.497148 19226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:44.497397 19226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:44.514060 19226 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.124:35101
I20260809 06:34:44.514096 19333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.124:35101 every 8 connection(s)
I20260809 06:34:44.515309 19226 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
I20260809 06:34:44.517163 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 19226
I20260809 06:34:44.517369 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786257083636440-31033-0/minicluster-data/master-2/wal/instance
I20260809 06:34:44.517987 31033 external_mini_cluster.cc:1428] Setting key 1bf696f7e80743361ab32036c5f58b22
I20260809 06:34:44.519554 19334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:44.528407 19334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257284, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:44.539731 19341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.519920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54276 (local address 127.30.78.124:35101)
0809 06:34:44.520752 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.520763 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.520808 (+ 45us) server_negotiation.cc:407] Connection header received
0809 06:34:44.522483 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.522505 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.522901 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.523255 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.525025 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.526406 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.528140 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.528771 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.528917 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.533278 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.533286 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.533296 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.533328 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.535932 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.536568 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.536574 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.536580 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.536749 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.537107 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.537111 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.537116 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.537634 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.537939 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.538319 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.538705 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":376,"threads_started":1}
I20260809 06:34:44.544059 19342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.531084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:34231 (local address 127.0.0.1:40402)
0809 06:34:44.531822 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.531878 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:44.532028 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:44.532366 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:44.532373 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:44.532910 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:44.533179 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.533189 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.534205 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.534209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.535263 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.535278 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.535973 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.535980 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.536122 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.536616 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:44.536638 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:44.538832 (+ 2194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:44.541537 (+ 2705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.541544 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.541551 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.542113 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.542589 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.542592 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.542594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.542712 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.543281 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:44.543288 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:44.543459 (+ 171us) client_negotiation.cc:769] Sending connection context
0809 06:34:44.543596 (+ 137us) client_negotiation.cc:240] Negotiation successful
0809 06:34:44.543796 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":345,"threads_started":1}
I20260809 06:34:44.544252 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.531109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40402 (local address 127.30.78.126:34231)
0809 06:34:44.531321 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.531328 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.531968 (+ 640us) server_negotiation.cc:407] Connection header received
0809 06:34:44.532140 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.532146 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.532208 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.532297 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.533331 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.534044 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.535396 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.535795 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.535899 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.539000 (+ 3101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.539005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.539008 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.539038 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.541437 (+ 2399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.542252 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.542261 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.542264 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.542447 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.542820 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.542825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.542828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.543150 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.543307 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.543681 (+ 374us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.543879 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:34:44.546994 19334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257284, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:34:44.559922 19342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.547731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:37711 (local address 127.0.0.1:47926)
0809 06:34:44.548036 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.548055 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:44.548151 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:44.548495 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:44.548500 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:44.548946 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:44.549111 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.549121 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.550451 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.550456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.551446 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.551458 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.552367 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.552372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.552517 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.552985 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:44.553000 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:44.555096 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:44.557630 (+ 2534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.557635 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.557639 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.558036 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.558401 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.558406 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.558409 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.558567 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.559048 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:44.559052 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:44.559199 (+ 147us) client_negotiation.cc:769] Sending connection context
0809 06:34:44.559339 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 06:34:44.559582 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200}
I20260809 06:34:44.559940 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.545846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40418 (local address 127.30.78.126:34231)
0809 06:34:44.546008 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.546017 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.546034 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:34:44.546081 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.546086 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.546154 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.546251 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.547634 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.548644 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.550181 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.550679 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.550802 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.554973 (+ 4171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.554980 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.554984 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.555021 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.557492 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.558200 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.558203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.558206 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.558332 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.558693 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.558697 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.558699 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.558953 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.559200 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.559443 (+ 243us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.559632 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260809 06:34:44.560128 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.547841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47926 (local address 127.30.78.125:37711)
0809 06:34:44.548021 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.548026 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.548107 (+ 81us) server_negotiation.cc:407] Connection header received
0809 06:34:44.548278 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.548283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.548361 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.548470 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.549274 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.550303 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.551586 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.552234 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.552361 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.555260 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.555265 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.555268 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.555297 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.557509 (+ 2212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.558143 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.558149 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.558153 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.558300 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.558669 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.558675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.558678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.558934 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.559064 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.559448 (+ 384us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.559646 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:34:44.561076 19334 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257284, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:34:44.573602 19342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.561828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54290)
0809 06:34:44.561940 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.561956 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:44.562047 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:44.562300 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:44.562303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:44.562589 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:44.562708 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.562715 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.563842 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.563848 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.564867 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.564878 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.565774 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.565781 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.565978 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.566451 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:44.566472 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:44.568256 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:44.571332 (+ 3076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.571336 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.571341 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.571737 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.572071 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.572075 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.572079 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.572199 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.572655 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:44.572660 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:44.572787 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 06:34:44.572900 (+ 113us) client_negotiation.cc:240] Negotiation successful
0809 06:34:44.573196 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260809 06:34:44.573683 19341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.561788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54290 (local address 127.30.78.124:35101)
0809 06:34:44.561948 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.561954 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.562002 (+ 48us) server_negotiation.cc:407] Connection header received
0809 06:34:44.562134 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.562139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.562199 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.562290 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.562862 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.563724 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.564993 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.565593 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.565756 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.568427 (+ 2671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.568434 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.568438 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.568475 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.571209 (+ 2734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.571840 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.571846 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.571849 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.571972 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.572293 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.572298 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.572302 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.572550 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.572671 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.572993 (+ 322us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.573353 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":142,"server-negotiator.queue_time_us":40}
I20260809 06:34:44.575910 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.561411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47938 (local address 127.30.78.125:37711)
0809 06:34:44.561562 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.561567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.561630 (+ 63us) server_negotiation.cc:407] Connection header received
0809 06:34:44.561820 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.561825 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.561891 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.561973 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.563433 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.564299 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.565758 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.566315 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.566430 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.570740 (+ 4310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.570745 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.570748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.570777 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.573173 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.573945 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.573950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.573952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.574143 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.574498 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.574503 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.574507 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.574820 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.575100 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.575378 (+ 278us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.575595 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:34:44.578948 19334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43: Bootstrap starting.
I20260809 06:34:44.580340 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:34:44.582150 19334 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:44.583214 19334 log.cc:824] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:44.586263 19334 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43: No bootstrap required, opened a new log
I20260809 06:34:44.598013 19334 raft_consensus.cc:348] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } }
I20260809 06:34:44.598448 19334 raft_consensus.cc:374] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:44.598583 19334 raft_consensus.cc:729] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d41427478a7a4e559ccdf4a76ea14b43, State: Initialized, Role: FOLLOWER
I20260809 06:34:44.599349 19334 consensus_queue.cc:260] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } }
I20260809 06:34:44.603935 19103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.584869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40424 (local address 127.30.78.126:34231)
0809 06:34:44.585053 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.585059 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.585708 (+ 649us) server_negotiation.cc:407] Connection header received
0809 06:34:44.585995 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.586002 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.586088 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.586159 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.588654 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.589869 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.592261 (+ 2392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.593001 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.593123 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.597269 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.597275 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.597280 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.597321 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.600622 (+ 3301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.601426 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.601431 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.601434 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.601600 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.602102 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.602108 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.602110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.602487 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.602707 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.603342 (+ 635us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.603584 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:34:44.606348 19359 sys_catalog.cc:455] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.606778 19359 sys_catalog.cc:458] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:34:44.608596 19334 sys_catalog.cc:564] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:34:44.611349 19341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.585336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54300 (local address 127.30.78.124:35101)
0809 06:34:44.585505 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.585510 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.594318 (+ 8808us) server_negotiation.cc:407] Connection header received
0809 06:34:44.594609 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.594619 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.594696 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.594788 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.596791 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.597815 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.600540 (+ 2725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.601277 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.601389 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.605082 (+ 3693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.605090 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.605095 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.605135 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.608523 (+ 3388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.609429 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.609434 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.609437 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.609601 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.610044 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.610049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.610053 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.610302 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.610539 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.610840 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.611035 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:34:44.611862 19221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.585882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47942 (local address 127.30.78.125:37711)
0809 06:34:44.586035 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.586040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.594665 (+ 8625us) server_negotiation.cc:407] Connection header received
0809 06:34:44.594944 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.594949 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.595026 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.595094 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.597143 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.598206 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.600667 (+ 2461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.601271 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.601369 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.605553 (+ 4184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.605560 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.605564 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.605603 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.608493 (+ 2890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.609331 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.609337 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.609341 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.609499 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.609960 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.609965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.609968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.610355 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.610596 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.611219 (+ 623us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.611477 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260809 06:34:44.623768 19379 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:34:44.623886 19379 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:34:44.620962 19226 master_runner.cc:186] Error getting master registration for 127.30.78.126:34231: OK, instance_id { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" instance_seqno: 1786257283537515 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:34:44.629133 19226 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 06:34:44.665578 19099 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } attempt: 4
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
I20260809 06:34:44.678912 19341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.666217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54304 (local address 127.30.78.124:35101)
0809 06:34:44.666378 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.666384 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.666467 (+ 83us) server_negotiation.cc:407] Connection header received
0809 06:34:44.666625 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.666631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.666715 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.666798 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.667561 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.668379 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.669544 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.670098 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.670215 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.673508 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.673515 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.673519 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.673556 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.676363 (+ 2807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.677112 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.677116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.677118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.677267 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.677648 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.677651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.677653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.677958 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.678064 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.678475 (+ 411us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.678631 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:34:44.679073 19101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.666172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54304)
0809 06:34:44.666363 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.666397 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:44.666515 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:44.666838 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:44.666843 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:44.667253 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:44.667423 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.667432 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.668500 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.668505 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.669408 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.669419 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.670252 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.670258 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.670436 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.671042 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:44.671059 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:44.673308 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:44.676485 (+ 3177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.676491 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.676495 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.677005 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.677364 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.677369 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.677373 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.677548 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.678061 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:44.678066 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:44.678245 (+ 179us) client_negotiation.cc:769] Sending connection context
0809 06:34:44.678398 (+ 153us) client_negotiation.cc:240] Negotiation successful
0809 06:34:44.678694 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 06:34:44.684820 19099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd: Bootstrap starting.
I20260809 06:34:44.688856 19099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:44.690114 19099 log.cc:824] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:44.693207 19099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd: No bootstrap required, opened a new log
I20260809 06:34:44.703900 19099 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } }
I20260809 06:34:44.704284 19099 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:44.704401 19099 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c5e9c066d724127b8e41d8905ec21cd, State: Initialized, Role: FOLLOWER
I20260809 06:34:44.705031 19099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } }
I20260809 06:34:44.705924 19385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.706256 19385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:34:44.707221 19099 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [sys.catalog]: configured and running, proceeding with master startup.
W20260809 06:34:44.716899 19403 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:34:44.717018 19403 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:34:44.723620 19213 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } attempt: 5
I20260809 06:34:44.716022 18983 master_runner.cc:186] Error getting master registration for 127.30.78.125:37711: OK, instance_id { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" instance_seqno: 1786257284007970 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:34:44.726850 18983 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 09 06:34:44 dist-test-slave-cvwc krb5kdc[18959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257283, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
I20260809 06:34:44.741031 19219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.724248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:35101 (local address 127.0.0.1:54306)
0809 06:34:44.724597 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:44.724616 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:44.724719 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:44.725787 (+ 1068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:44.725792 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:44.726309 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:44.726524 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.726537 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.728177 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.728183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.729589 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:44.729605 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.730660 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.730667 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:44.730912 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.731568 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:44.731591 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:44.734340 (+ 2749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:44.738290 (+ 3950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.738296 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.738301 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.738838 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.739228 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:44.739233 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:44.739237 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:44.739412 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:44.740030 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:44.740036 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:44.740184 (+ 148us) client_negotiation.cc:769] Sending connection context
0809 06:34:44.740345 (+ 161us) client_negotiation.cc:240] Negotiation successful
0809 06:34:44.740646 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225}
I20260809 06:34:44.741329 19341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:44.724914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54306 (local address 127.30.78.124:35101)
0809 06:34:44.725080 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:44.725085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:44.725103 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:34:44.725154 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:44.725159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:44.725229 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:44.725319 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:44.726897 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.728011 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.729771 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:44.730503 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:44.730634 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:44.734545 (+ 3911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:44.734552 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:44.734558 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:44.734600 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:44.738156 (+ 3556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.738966 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.738972 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.738975 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.739116 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:44.739528 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:44.739533 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:44.739536 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:44.739911 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:44.740070 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:44.740461 (+ 391us) server_negotiation.cc:299] Negotiation successful
0809 06:34:44.740700 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:34:44.746791 19213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb: Bootstrap starting.
W20260809 06:34:44.749440 19268 tablet.cc:2369] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:34:44.750630 19213 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:44.751868 19213 log.cc:824] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:44.755141 19213 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb: No bootstrap required, opened a new log
I20260809 06:34:44.765799 19213 raft_consensus.cc:348] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } }
I20260809 06:34:44.766199 19213 raft_consensus.cc:374] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:44.766306 19213 raft_consensus.cc:729] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25a0c24f39548869bf958e0242eb0eb, State: Initialized, Role: FOLLOWER
I20260809 06:34:44.766947 19213 consensus_queue.cc:260] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } }
I20260809 06:34:44.767939 19409 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.768399 19409 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:34:44.769215 19213 sys_catalog.cc:564] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [sys.catalog]: configured and running, proceeding with master startup.
W20260809 06:34:44.778563 19019 tablet.cc:2369] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:34:44.787556 19110 master_runner.cc:263] No leader master found from master c25a0c24f39548869bf958e0242eb0eb
I20260809 06:34:44.787699 19110 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260809 06:34:44.790251 19429 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:34:44.790457 19429 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:34:44.803683 19359 raft_consensus.cc:482] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:34:44.803979 19359 raft_consensus.cc:504] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } }
I20260809 06:34:44.805569 19359 leader_election.cc:288] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c5e9c066d724127b8e41d8905ec21cd (127.30.78.126:34231), c25a0c24f39548869bf958e0242eb0eb (127.30.78.125:37711)
I20260809 06:34:44.806902 19170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d41427478a7a4e559ccdf4a76ea14b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25a0c24f39548869bf958e0242eb0eb" is_pre_election: true
I20260809 06:34:44.807447 19170 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41427478a7a4e559ccdf4a76ea14b43 in term 0.
I20260809 06:34:44.808499 19054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d41427478a7a4e559ccdf4a76ea14b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c5e9c066d724127b8e41d8905ec21cd" is_pre_election: true
I20260809 06:34:44.809027 19054 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d41427478a7a4e559ccdf4a76ea14b43 in term 0.
I20260809 06:34:44.810988 19261 leader_election.cc:302] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c25a0c24f39548869bf958e0242eb0eb, d41427478a7a4e559ccdf4a76ea14b43; no voters:
I20260809 06:34:44.811421 19359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:34:44.811551 19359 raft_consensus.cc:482] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:34:44.811643 19359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:44.814970 19359 raft_consensus.cc:504] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } }
I20260809 06:34:44.817277 19054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d41427478a7a4e559ccdf4a76ea14b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c5e9c066d724127b8e41d8905ec21cd"
I20260809 06:34:44.817483 19054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:44.820765 19054 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41427478a7a4e559ccdf4a76ea14b43 in term 1.
I20260809 06:34:44.821260 19259 leader_election.cc:302] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c5e9c066d724127b8e41d8905ec21cd, d41427478a7a4e559ccdf4a76ea14b43; no voters:
I20260809 06:34:44.821841 19170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d41427478a7a4e559ccdf4a76ea14b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25a0c24f39548869bf958e0242eb0eb"
I20260809 06:34:44.822036 19170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:44.822669 19359 leader_election.cc:288] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [CANDIDATE]: Term 1 election: Requested vote from peers 5c5e9c066d724127b8e41d8905ec21cd (127.30.78.126:34231), c25a0c24f39548869bf958e0242eb0eb (127.30.78.125:37711)
I20260809 06:34:44.823025 19359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:34:44.823390 19359 raft_consensus.cc:686] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [term 1 LEADER]: Becoming Leader. State: Replica: d41427478a7a4e559ccdf4a76ea14b43, State: Running, Role: LEADER
I20260809 06:34:44.824101 19359 consensus_queue.cc:237] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } }
I20260809 06:34:44.825140 19170 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d41427478a7a4e559ccdf4a76ea14b43 in term 1.
I20260809 06:34:44.854971 19434 sys_catalog.cc:455] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d41427478a7a4e559ccdf4a76ea14b43. Latest consensus state: current_term: 1 leader_uuid: "d41427478a7a4e559ccdf4a76ea14b43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.855536 19434 sys_catalog.cc:458] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:44.866312 19437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:34:44.868486 19437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:34:44.889870 19170 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [term 1 FOLLOWER]: Refusing update from remote peer d41427478a7a4e559ccdf4a76ea14b43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:34:44.889938 19054 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [term 1 FOLLOWER]: Refusing update from remote peer d41427478a7a4e559ccdf4a76ea14b43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:34:44.890892 19359 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:34:44.891536 19359 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:34:44.931994 19385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [sys.catalog]: SysCatalogTable state changed. Reason: New leader d41427478a7a4e559ccdf4a76ea14b43. Latest consensus state: current_term: 1 leader_uuid: "d41427478a7a4e559ccdf4a76ea14b43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.932312 19385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:34:44.939465 19440 mvcc.cc:205] Tried to move back new op lower bound from 7316509838899302400 to 7316509838650925056. Current Snapshot: MvccSnapshot[applied={T|T < 7316509838899302400}]
I20260809 06:34:44.944655 19359 sys_catalog.cc:455] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d41427478a7a4e559ccdf4a76ea14b43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.944976 19359 sys_catalog.cc:458] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:44.946846 19437 catalog_manager.cc:1347] Generated new cluster ID: 85bcb2fa07374bbb8a00449934e230a3
I20260809 06:34:44.946961 19437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:34:44.956096 19385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d41427478a7a4e559ccdf4a76ea14b43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.956351 19385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:34:44.966224 19409 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader d41427478a7a4e559ccdf4a76ea14b43. Latest consensus state: current_term: 1 leader_uuid: "d41427478a7a4e559ccdf4a76ea14b43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.966557 19409 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:34:44.972477 19434 sys_catalog.cc:455] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d41427478a7a4e559ccdf4a76ea14b43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.972744 19434 sys_catalog.cc:458] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:44.973055 19439 mvcc.cc:205] Tried to move back new op lower bound from 7316509838899302400 to 7316509838650925056. Current Snapshot: MvccSnapshot[applied={T|T < 7316509838899302400}]
I20260809 06:34:44.978195 19409 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d41427478a7a4e559ccdf4a76ea14b43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c5e9c066d724127b8e41d8905ec21cd" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34231 } } peers { permanent_uuid: "c25a0c24f39548869bf958e0242eb0eb" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 37711 } } peers { permanent_uuid: "d41427478a7a4e559ccdf4a76ea14b43" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 35101 } } }
I20260809 06:34:44.978431 19409 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:34:45.000741 19437 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:34:45.002560 19437 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:34:45.018258 19437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d41427478a7a4e559ccdf4a76ea14b43: Generated new TSK 0
I20260809 06:34:45.023218 19437 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:34:45.718981 19403 catalog_manager.cc:1259] Loaded cluster ID: 85bcb2fa07374bbb8a00449934e230a3
I20260809 06:34:45.719081 19403 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd: loading cluster ID for follower catalog manager: success
I20260809 06:34:45.721485 19403 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd: acquiring CA information for follower catalog manager: success
I20260809 06:34:45.723197 19403 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5c5e9c066d724127b8e41d8905ec21cd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:34:45.792454 19429 catalog_manager.cc:1259] Loaded cluster ID: 85bcb2fa07374bbb8a00449934e230a3
I20260809 06:34:45.792559 19429 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb: loading cluster ID for follower catalog manager: success
I20260809 06:34:45.795002 19429 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb: acquiring CA information for follower catalog manager: success
I20260809 06:34:45.796703 19429 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c25a0c24f39548869bf958e0242eb0eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:34:46.174558 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 18983
I20260809 06:34:46.175753 19088 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:46.285487 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 18983
I20260809 06:34:46.312199 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 19110
I20260809 06:34:46.313279 19206 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:46.416471 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 19110
I20260809 06:34:46.440194 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 19226
I20260809 06:34:46.441220 19328 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:46.547034 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 19226
2026-08-09T06:34:46Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4870 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:34:46 dist-test-slave-cvwc krb5kdc[19464](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:34:46 dist-test-slave-cvwc krb5kdc[19464](info): set up 2 sockets
Aug 09 06:34:46 dist-test-slave-cvwc krb5kdc[19464](info): commencing operation
krb5kdc: starting...
W20260809 06:34:47.774832 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:34:47 dist-test-slave-cvwc krb5kdc[19464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:34:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:34:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:34:48.000556 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:37913
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:45997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:37913
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:48.316046 19493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:48.316294 19493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:48.316396 19493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:48.323305 19493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:34:48.323405 19493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:48.323455 19493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:48.323509 19493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:34:48.323550 19493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:34:48.332681 19493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:45997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:37913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:37913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:48.333801 19493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:48.335005 19493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:48.345703 19500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:48.345791 19506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:48.345811 19501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:48.346637 19493 server_base.cc:1034] running on GCE node
I20260809 06:34:48.347334 19493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:48.348567 19493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:48.349787 19493 hybrid_clock.cc:648] HybridClock initialized: now 1786257288349736 us; error 35 us; skew 500 ppm
I20260809 06:34:48.350100 19493 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:48 dist-test-slave-cvwc krb5kdc[19464](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257288, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:48.352906 19493 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:34:48.354321 19493 webserver.cc:460] Webserver started at http://127.30.78.126:35415/ using document root <none> and password file <none>
I20260809 06:34:48.354929 19493 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:48.355044 19493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:48.355321 19493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:34:48.358158 19493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "ceab545239ea4554a67ef986d43800f5"
format_stamp: "Formatted at 2026-08-09 06:34:48 on dist-test-slave-cvwc"
server_key: "9e04de7dc279bdffec6fb5c94860db23"
server_key_iv: "d21da8e01e53fbe436434239bed8b79a"
server_key_version: "encryptionkey@0"
I20260809 06:34:48.358875 19493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "ceab545239ea4554a67ef986d43800f5"
format_stamp: "Formatted at 2026-08-09 06:34:48 on dist-test-slave-cvwc"
server_key: "9e04de7dc279bdffec6fb5c94860db23"
server_key_iv: "d21da8e01e53fbe436434239bed8b79a"
server_key_version: "encryptionkey@0"
I20260809 06:34:48.363652 19493 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:34:48.366829 19514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:48.368036 19493 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:34:48.368180 19493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "ceab545239ea4554a67ef986d43800f5"
format_stamp: "Formatted at 2026-08-09 06:34:48 on dist-test-slave-cvwc"
server_key: "9e04de7dc279bdffec6fb5c94860db23"
server_key_iv: "d21da8e01e53fbe436434239bed8b79a"
server_key_version: "encryptionkey@0"
I20260809 06:34:48.368348 19493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:48.415776 19493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:48.419467 19493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:48.419713 19493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:48.436338 19493 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:37913
I20260809 06:34:48.436369 19592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:37913 every 8 connection(s)
I20260809 06:34:48.437551 19493 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:34:48.441028 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 19493
I20260809 06:34:48.441174 19594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:48.441236 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:34:48.441929 31033 external_mini_cluster.cc:1428] Setting key b42ef457e85397d5c6459fe3624af109
I20260809 06:34:48.454425 19594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5: Bootstrap starting.
Aug 09 06:34:48 dist-test-slave-cvwc krb5kdc[19464](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:48.457265 19594 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:48.458563 19594 log.cc:824] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:48.461581 19594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5: No bootstrap required, opened a new log
I20260809 06:34:48.464956 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:48.443750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51502 (local address 127.30.78.126:37913)
0809 06:34:48.444577 (+ 827us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:48.444592 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:48.444949 (+ 357us) server_negotiation.cc:407] Connection header received
0809 06:34:48.447044 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:48.447071 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:48.447524 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:48.447965 (+ 441us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:48.449165 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:48.451113 (+ 1948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:48.452340 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:48.453317 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:48.453486 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:48.457149 (+ 3663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:48.457164 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:48.457182 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:48.457226 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:48.460700 (+ 3474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:48.461326 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:48.461333 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:48.461341 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:48.461536 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:48.461943 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:48.461947 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:48.461950 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:48.462626 (+ 676us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:48.462912 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:48.463206 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 06:34:48.463643 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":347,"threads_started":1}
I20260809 06:34:48.468852 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:34:48.470685 19594 raft_consensus.cc:348] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceab545239ea4554a67ef986d43800f5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37913 } }
I20260809 06:34:48.471108 19594 raft_consensus.cc:374] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:48.471208 19594 raft_consensus.cc:729] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceab545239ea4554a67ef986d43800f5, State: Initialized, Role: FOLLOWER
I20260809 06:34:48.471804 19594 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceab545239ea4554a67ef986d43800f5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37913 } }
I20260809 06:34:48.472051 19594 raft_consensus.cc:388] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:34:48.472189 19594 raft_consensus.cc:482] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:34:48.472345 19594 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:48.474541 19594 raft_consensus.cc:504] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceab545239ea4554a67ef986d43800f5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37913 } }
I20260809 06:34:48.474997 19594 leader_election.cc:302] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ceab545239ea4554a67ef986d43800f5; no voters:
I20260809 06:34:48.475519 19594 leader_election.cc:288] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:34:48.475631 19599 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:34:48.476285 19599 raft_consensus.cc:686] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [term 1 LEADER]: Becoming Leader. State: Replica: ceab545239ea4554a67ef986d43800f5, State: Running, Role: LEADER
I20260809 06:34:48.476850 19599 consensus_queue.cc:237] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceab545239ea4554a67ef986d43800f5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37913 } }
I20260809 06:34:48.477440 19594 sys_catalog.cc:564] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:34:48.479334 19603 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ceab545239ea4554a67ef986d43800f5. Latest consensus state: current_term: 1 leader_uuid: "ceab545239ea4554a67ef986d43800f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceab545239ea4554a67ef986d43800f5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37913 } } }
I20260809 06:34:48.479727 19603 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:48.479631 19601 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ceab545239ea4554a67ef986d43800f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceab545239ea4554a67ef986d43800f5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37913 } } }
I20260809 06:34:48.479903 19601 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:48.481273 19613 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:34:48.486409 19613 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:34:48.495355 19613 catalog_manager.cc:1347] Generated new cluster ID: 22678578deb84979bad30ab67687034f
I20260809 06:34:48.495477 19613 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:34:48.518283 19613 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:34:48.519536 19613 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:34:48.525695 19613 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ceab545239ea4554a67ef986d43800f5: Generated new TSK 0
I20260809 06:34:48.526443 19613 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:34:48.581202 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 19493
I20260809 06:34:48.582379 19587 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:48.676452 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 19493
2026-08-09T06:34:48Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2122 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:34:48 dist-test-slave-cvwc krb5kdc[19638](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:34:48 dist-test-slave-cvwc krb5kdc[19638](info): set up 2 sockets
Aug 09 06:34:48 dist-test-slave-cvwc krb5kdc[19638](info): commencing operation
krb5kdc: starting...
W20260809 06:34:49.884366 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:34:50 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:34:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:34:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:34:50.133065 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:46301
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:46301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:50.451037 19658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:50.451319 19658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:50.451452 19658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:50.458527 19658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:34:50.458632 19658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:50.458711 19658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:50.458789 19658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:34:50.458853 19658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:34:50.468295 19658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:46301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:46301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:50.469544 19658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:50.470842 19658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:50.482300 19670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:50.482264 19675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:50.482348 19672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:50.483419 19658 server_base.cc:1034] running on GCE node
I20260809 06:34:50.484184 19658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:50.485520 19658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:50.486719 19658 hybrid_clock.cc:648] HybridClock initialized: now 1786257290486650 us; error 55 us; skew 500 ppm
I20260809 06:34:50.487041 19658 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:50 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257290, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:50.489943 19658 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:34:50.491285 19658 webserver.cc:460] Webserver started at http://127.30.78.126:46591/ using document root <none> and password file <none>
I20260809 06:34:50.491906 19658 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:50.492031 19658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:50.492322 19658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:34:50.495215 19658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "f8c55a5cd19e4ad2add8fa34af2505b5"
format_stamp: "Formatted at 2026-08-09 06:34:50 on dist-test-slave-cvwc"
server_key: "1d96a20ff0cf1b600f752c038f134431"
server_key_iv: "63b49928cb9f8e7ae8d3e32ae0e88863"
server_key_version: "encryptionkey@0"
I20260809 06:34:50.495946 19658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "f8c55a5cd19e4ad2add8fa34af2505b5"
format_stamp: "Formatted at 2026-08-09 06:34:50 on dist-test-slave-cvwc"
server_key: "1d96a20ff0cf1b600f752c038f134431"
server_key_iv: "63b49928cb9f8e7ae8d3e32ae0e88863"
server_key_version: "encryptionkey@0"
I20260809 06:34:50.500728 19658 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 06:34:50.503934 19682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:50.505095 19658 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:34:50.505254 19658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "f8c55a5cd19e4ad2add8fa34af2505b5"
format_stamp: "Formatted at 2026-08-09 06:34:50 on dist-test-slave-cvwc"
server_key: "1d96a20ff0cf1b600f752c038f134431"
server_key_iv: "63b49928cb9f8e7ae8d3e32ae0e88863"
server_key_version: "encryptionkey@0"
I20260809 06:34:50.505426 19658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:50.524801 19658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:50.528286 19658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:50.528532 19658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:50.546216 19658 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:46301
I20260809 06:34:50.546252 19769 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:46301 every 8 connection(s)
I20260809 06:34:50.547546 19658 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:34:50.550930 19770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:50.552443 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 19658
I20260809 06:34:50.552676 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:34:50.553539 31033 external_mini_cluster.cc:1428] Setting key 37bc8825dae5314a255f0629a5396e1b
I20260809 06:34:50.563431 19770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Bootstrap starting.
I20260809 06:34:50.566398 19770 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:50.567462 19770 log.cc:824] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:34:50 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:50.570921 19770 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: No bootstrap required, opened a new log
I20260809 06:34:50.576045 19776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:50.555620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51856 (local address 127.30.78.126:46301)
0809 06:34:50.556375 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:50.556387 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:50.556437 (+ 50us) server_negotiation.cc:407] Connection header received
0809 06:34:50.558136 (+ 1699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:50.558158 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:50.558553 (+ 395us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:50.558895 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:50.560467 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:50.561954 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:50.563326 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:50.564045 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:50.564247 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:50.568699 (+ 4452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:50.568706 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:50.568719 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:50.568751 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:50.571854 (+ 3103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:50.572584 (+ 730us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:50.572596 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:50.572601 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:50.572793 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:50.573203 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:50.573214 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:50.573217 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:50.573800 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:50.574124 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:50.574588 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 06:34:50.575031 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":313,"threads_started":1}
I20260809 06:34:50.578821 19770 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:50.579254 19770 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:50.579349 19770 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8c55a5cd19e4ad2add8fa34af2505b5, State: Initialized, Role: FOLLOWER
I20260809 06:34:50.579903 19770 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:50.580124 19770 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:34:50.580255 19770 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:34:50.580420 19770 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:50.582823 19770 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:50.583261 19770 leader_election.cc:302] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8c55a5cd19e4ad2add8fa34af2505b5; no voters:
I20260809 06:34:50.583758 19770 leader_election.cc:288] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:34:50.583882 19780 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:34:50.584555 19780 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 1 LEADER]: Becoming Leader. State: Replica: f8c55a5cd19e4ad2add8fa34af2505b5, State: Running, Role: LEADER
I20260809 06:34:50.585047 19780 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:50.585682 19770 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:34:50.587929 19781 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } } }
I20260809 06:34:50.588318 19781 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:50.588438 19783 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8c55a5cd19e4ad2add8fa34af2505b5. Latest consensus state: current_term: 1 leader_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } } }
I20260809 06:34:50.588757 19783 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:50.590502 19800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:34:50.594635 19800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:34:50.602454 19800 catalog_manager.cc:1347] Generated new cluster ID: 685702eb1e4d44e99a60b82d0d58c3f8
I20260809 06:34:50.602555 19800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:34:50.622447 19800 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:34:50.623662 19800 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:34:50.631743 19800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Generated new TSK 0
I20260809 06:34:50.632455 19800 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:34:50.688848 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:46301
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:51.008294 19819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:51.008550 19819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:51.008671 19819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:51.015664 19819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:51.015758 19819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:51.015921 19819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:34:51.025074 19819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:51.026269 19819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:51.027475 19819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:51.039489 19829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:51.039579 19834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:51.039466 19830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:51.040484 19819 server_base.cc:1034] running on GCE node
I20260809 06:34:51.041030 19819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:51.041911 19819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:51.043099 19819 hybrid_clock.cc:648] HybridClock initialized: now 1786257291043050 us; error 39 us; skew 500 ppm
I20260809 06:34:51.043371 19819 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:51 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257291, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:51.046299 19819 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:34:51.047580 19819 webserver.cc:460] Webserver started at http://127.30.78.65:45975/ using document root <none> and password file <none>
I20260809 06:34:51.048189 19819 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:51.048302 19819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:51.048578 19819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:34:51.051324 19819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "74cad998a09c4660bc2b858635639aec"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "c991813660fffdb66c8636ccc5ae6d94"
server_key_iv: "225e188ab2d423feb854912b1d29cc95"
server_key_version: "encryptionkey@0"
I20260809 06:34:51.052079 19819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "74cad998a09c4660bc2b858635639aec"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "c991813660fffdb66c8636ccc5ae6d94"
server_key_iv: "225e188ab2d423feb854912b1d29cc95"
server_key_version: "encryptionkey@0"
I20260809 06:34:51.056911 19819 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 06:34:51.060071 19843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:51.061273 19819 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:34:51.061422 19819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "74cad998a09c4660bc2b858635639aec"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "c991813660fffdb66c8636ccc5ae6d94"
server_key_iv: "225e188ab2d423feb854912b1d29cc95"
server_key_version: "encryptionkey@0"
I20260809 06:34:51.061600 19819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:51.084744 19819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:51.088454 19819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:51.088701 19819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:51.089599 19819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:51.090926 19819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:51.091007 19819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:51.091127 19819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:51.091178 19819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:51.119843 19819 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:45609
I20260809 06:34:51.119890 20038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:45609 every 8 connection(s)
I20260809 06:34:51.121042 19819 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:34:51.122401 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 19819
I20260809 06:34:51.122596 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:34:51.123211 31033 external_mini_cluster.cc:1428] Setting key e3bbab1c4ad5d79c46ac1ce6ef8447be
Aug 09 06:34:51 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257291, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:51.140416 20041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:51.123428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:40957 (local address 127.30.78.126:46301)
0809 06:34:51.124155 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:51.124160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:51.124873 (+ 713us) server_negotiation.cc:407] Connection header received
0809 06:34:51.126717 (+ 1844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:51.126724 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:51.126803 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:51.126917 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:51.128277 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:51.129265 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:51.130796 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:51.131357 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:51.131501 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:51.134673 (+ 3172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:51.134679 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:51.134683 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:51.134719 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:51.137537 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:51.138259 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:51.138265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:51.138269 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:51.138432 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:51.138811 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:51.138815 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:51.138818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:51.139133 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:51.139266 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:51.139869 (+ 603us) server_negotiation.cc:299] Negotiation successful
0809 06:34:51.140077 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":496,"threads_started":1}
I20260809 06:34:51.141077 20042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:51.123880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:40957)
0809 06:34:51.124697 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:51.124747 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:51.126452 (+ 1705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:51.127089 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:51.127097 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:51.127563 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:51.128102 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:51.128120 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:51.129392 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:51.129396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:51.130628 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:51.130641 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:51.131576 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:51.131582 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:51.131771 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:51.132362 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:51.132385 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:51.134460 (+ 2075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:51.137660 (+ 3200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:51.137666 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:51.137676 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:51.138107 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:51.138540 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:51.138543 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:51.138545 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:51.138708 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:51.139237 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:51.139242 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:51.139525 (+ 283us) client_negotiation.cc:769] Sending connection context
0809 06:34:51.139728 (+ 203us) client_negotiation.cc:240] Negotiation successful
0809 06:34:51.140066 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":327,"threads_started":1}
I20260809 06:34:51.142544 20039 heartbeater.cc:347] Connected to a master server at 127.30.78.126:46301
I20260809 06:34:51.142817 20039 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:51.143479 20039 heartbeater.cc:511] Master 127.30.78.126:46301 requested a full tablet report, sending...
I20260809 06:34:51.145349 19713 ts_manager.cc:194] Registered new tserver with Master: 74cad998a09c4660bc2b858635639aec (127.30.78.65:45609)
I20260809 06:34:51.146714 19713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:40957
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:34:51.177979 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:46301
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:51.492319 20046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:51.492578 20046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:51.492678 20046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:51.499914 20046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:51.500016 20046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:51.500135 20046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:34:51.509342 20046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:51.510522 20046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:51.511727 20046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:51.523643 20052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:51.523687 20055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:51.523710 20051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:51.524466 20046 server_base.cc:1034] running on GCE node
I20260809 06:34:51.524968 20046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:51.525786 20046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:51.527002 20046 hybrid_clock.cc:648] HybridClock initialized: now 1786257291526937 us; error 46 us; skew 500 ppm
I20260809 06:34:51.527292 20046 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:51 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257291, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:51.530303 20046 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:34:51.531635 20046 webserver.cc:460] Webserver started at http://127.30.78.66:40183/ using document root <none> and password file <none>
I20260809 06:34:51.532246 20046 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:51.532361 20046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:51.532626 20046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:34:51.535347 20046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "fbfd9646508e43cea03b0ef4462e0dac"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "f39406a93332a9f2f42cf2058f67da7f"
server_key_iv: "06b66e7551b0e6d7fe96b7c8879b012d"
server_key_version: "encryptionkey@0"
I20260809 06:34:51.536069 20046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "fbfd9646508e43cea03b0ef4462e0dac"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "f39406a93332a9f2f42cf2058f67da7f"
server_key_iv: "06b66e7551b0e6d7fe96b7c8879b012d"
server_key_version: "encryptionkey@0"
I20260809 06:34:51.540747 20046 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260809 06:34:51.543916 20064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:51.545096 20046 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:34:51.545255 20046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "fbfd9646508e43cea03b0ef4462e0dac"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "f39406a93332a9f2f42cf2058f67da7f"
server_key_iv: "06b66e7551b0e6d7fe96b7c8879b012d"
server_key_version: "encryptionkey@0"
I20260809 06:34:51.545454 20046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:51.559514 20046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:51.563408 20046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:51.563665 20046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:51.564580 20046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:51.565994 20046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:51.566076 20046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:51.566172 20046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:51.566229 20046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:51.596251 20247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:38773 every 8 connection(s)
I20260809 06:34:51.596251 20046 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:38773
I20260809 06:34:51.597642 20046 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:34:51.598027 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 20046
I20260809 06:34:51.598197 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:34:51.598733 31033 external_mini_cluster.cc:1428] Setting key d9be2c83191883d8de06d82fa54df055
Aug 09 06:34:51 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257291, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:51.617933 20041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:51.600562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:38937 (local address 127.30.78.126:46301)
0809 06:34:51.600763 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:51.600769 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:51.601906 (+ 1137us) server_negotiation.cc:407] Connection header received
0809 06:34:51.603802 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:51.603809 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:51.603899 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:51.603995 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:51.605508 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:51.606319 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:51.607890 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:51.608354 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:51.608481 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:51.612213 (+ 3732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:51.612218 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:51.612221 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:51.612253 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:51.614748 (+ 2495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:51.615605 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:51.615609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:51.615611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:51.615738 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:51.616260 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:51.616264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:51.616268 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:51.616522 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:51.616631 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:51.617484 (+ 853us) server_negotiation.cc:299] Negotiation successful
0809 06:34:51.617653 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:34:51.619448 20251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:51.600975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:38937)
0809 06:34:51.601749 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:51.601803 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:51.603537 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:51.604254 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:51.604262 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:51.604771 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:51.605334 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:51.605352 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:51.606484 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:51.606488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:51.607737 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:51.607750 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:51.608616 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:51.608626 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:51.608884 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:51.609558 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:51.609582 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:51.611991 (+ 2409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:51.614892 (+ 2901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:51.614901 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:51.614916 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:51.615503 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:51.615840 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:51.615845 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:51.615849 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:51.616107 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:51.616657 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:51.616665 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:51.617075 (+ 410us) client_negotiation.cc:769] Sending connection context
0809 06:34:51.617412 (+ 337us) client_negotiation.cc:240] Negotiation successful
0809 06:34:51.618010 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":305,"threads_started":1}
I20260809 06:34:51.620903 20248 heartbeater.cc:347] Connected to a master server at 127.30.78.126:46301
I20260809 06:34:51.621250 20248 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:51.622262 20248 heartbeater.cc:511] Master 127.30.78.126:46301 requested a full tablet report, sending...
I20260809 06:34:51.623960 19713 ts_manager.cc:194] Registered new tserver with Master: fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773)
I20260809 06:34:51.624754 19713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:38937
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:34:51.656468 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:46301
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:51.981036 20263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:51.981302 20263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:51.981436 20263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:51.988587 20263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:51.988685 20263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:51.988833 20263 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:34:51.998447 20263 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:51.999630 20263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:52.000877 20263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:52.013247 20276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:52.013291 20279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:52.013541 20272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:52.014285 20263 server_base.cc:1034] running on GCE node
I20260809 06:34:52.014937 20263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:52.015847 20263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:52.017057 20263 hybrid_clock.cc:648] HybridClock initialized: now 1786257292016999 us; error 37 us; skew 500 ppm
I20260809 06:34:52.017416 20263 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:52 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257292, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:52.024075 20263 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:34:52.025444 20263 webserver.cc:460] Webserver started at http://127.30.78.67:45867/ using document root <none> and password file <none>
I20260809 06:34:52.026104 20263 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:52.026237 20263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:52.026526 20263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:34:52.029268 20263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "f755abfc4b4b4695ae075d94bd31686c"
format_stamp: "Formatted at 2026-08-09 06:34:52 on dist-test-slave-cvwc"
server_key: "3e39a8f111caa5c16fd15593c9220a0b"
server_key_iv: "6f76386e94be03d1138f860ff523a45c"
server_key_version: "encryptionkey@0"
I20260809 06:34:52.030095 20263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "f755abfc4b4b4695ae075d94bd31686c"
format_stamp: "Formatted at 2026-08-09 06:34:52 on dist-test-slave-cvwc"
server_key: "3e39a8f111caa5c16fd15593c9220a0b"
server_key_iv: "6f76386e94be03d1138f860ff523a45c"
server_key_version: "encryptionkey@0"
I20260809 06:34:52.034832 20263 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:34:52.038123 20287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:52.039299 20263 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 06:34:52.039454 20263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "f755abfc4b4b4695ae075d94bd31686c"
format_stamp: "Formatted at 2026-08-09 06:34:52 on dist-test-slave-cvwc"
server_key: "3e39a8f111caa5c16fd15593c9220a0b"
server_key_iv: "6f76386e94be03d1138f860ff523a45c"
server_key_version: "encryptionkey@0"
I20260809 06:34:52.039641 20263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:52.052901 20263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:52.056420 20263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:52.056674 20263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:52.057545 20263 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:52.058840 20263 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:52.058919 20263 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:52.059037 20263 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:52.059095 20263 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:52.088402 20263 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:38909
I20260809 06:34:52.088419 20474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:38909 every 8 connection(s)
I20260809 06:34:52.089675 20263 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:34:52.098686 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 20263
I20260809 06:34:52.098865 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:34:52.099408 31033 external_mini_cluster.cc:1428] Setting key 141382db3be08feb45fb7fb9e3082021
Aug 09 06:34:52 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257292, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:52.108063 20041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.092111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:52201 (local address 127.30.78.126:46301)
0809 06:34:52.092288 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.092292 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.093389 (+ 1097us) server_negotiation.cc:407] Connection header received
0809 06:34:52.095177 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.095182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.095266 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.095353 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:52.096802 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.097550 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.099471 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.099900 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.100013 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.103353 (+ 3340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:52.103358 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:52.103361 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:52.103395 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:52.105674 (+ 2279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.106329 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.106333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.106335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.106450 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.106766 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.106769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.106771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.107026 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:52.107133 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.107654 (+ 521us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.107811 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:34:52.108940 20477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.092552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:52201)
0809 06:34:52.093243 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.093283 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:52.094916 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:52.095590 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:52.095598 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:52.096076 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:52.096635 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.096652 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.097696 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.097700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.099293 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.099309 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.100145 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.100151 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.100340 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.100984 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:52.101004 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:52.103162 (+ 2158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:52.105846 (+ 2684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:52.105852 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:52.105862 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:52.106241 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:52.106522 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:52.106525 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:52.106527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:52.106689 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:52.107109 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:52.107114 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:52.107387 (+ 273us) client_negotiation.cc:769] Sending connection context
0809 06:34:52.107581 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 06:34:52.107910 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":258,"threads_started":1}
I20260809 06:34:52.110136 20475 heartbeater.cc:347] Connected to a master server at 127.30.78.126:46301
I20260809 06:34:52.110412 20475 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:52.111078 20475 heartbeater.cc:511] Master 127.30.78.126:46301 requested a full tablet report, sending...
I20260809 06:34:52.112381 19713 ts_manager.cc:194] Registered new tserver with Master: f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909)
I20260809 06:34:52.113224 19713 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:52201
I20260809 06:34:52.114521 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:34:52.131150 20041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.118719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51872 (local address 127.30.78.126:46301)
0809 06:34:52.118862 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.118868 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.119308 (+ 440us) server_negotiation.cc:407] Connection header received
0809 06:34:52.119492 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.119498 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.119554 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.119628 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:52.121333 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.122076 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.123903 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.124279 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.124399 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.126716 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:52.126720 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:52.126723 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:52.126752 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:52.128915 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.129477 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.129480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.129483 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.129594 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.129911 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.129914 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.129917 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.130191 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:52.130365 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.130692 (+ 327us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.130867 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 06:34:52.134729 19713 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:34:52.141398 19713 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:34:52.149271 20039 heartbeater.cc:503] Master 127.30.78.126:46301 was elected leader, sending a full tablet report...
I20260809 06:34:52.160235 20495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.152705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:38773 (local address 127.0.0.1:44972)
0809 06:34:52.153311 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.153369 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:52.153522 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:52.154474 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:52.154478 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:52.154503 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:52.154790 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.154799 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.156108 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.156113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.158043 (+ 1930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.158057 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.159338 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.159345 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.159541 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.159578 (+ 37us) client_negotiation.cc:769] Sending connection context
0809 06:34:52.159684 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 06:34:52.159861 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":218,"threads_started":1}
I20260809 06:34:52.161257 20497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.152833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44972 (local address 127.30.78.66:38773)
0809 06:34:52.153401 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.153409 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.153438 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:34:52.153797 (+ 359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.153805 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.154046 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.154240 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:52.154951 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.155979 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.158190 (+ 2211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.159132 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.159255 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.159452 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.159754 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.161022 (+ 1268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":273,"threads_started":1}
I20260809 06:34:52.165334 20143 tablet_service.cc:1467] Processing CreateTablet for tablet a55c846233d748dea13e30459fa3a2a3 (DEFAULT_TABLE table=test-table [id=548067ed1e9c4f5e8ffd414047e2cdb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:34:52.166841 20143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a55c846233d748dea13e30459fa3a2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:52.168326 20495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.153542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47318)
0809 06:34:52.160681 (+ 7139us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.160698 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:52.160787 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:52.162305 (+ 1518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:52.162310 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:52.162334 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:52.162495 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.162507 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.163974 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.163980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.165820 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.165835 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.167603 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.167610 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.167791 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.167824 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:34:52.167912 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 06:34:52.168040 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7052,"thread_start_us":8464,"threads_started":1}
I20260809 06:34:52.168447 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.154029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47318 (local address 127.30.78.65:45609)
0809 06:34:52.161869 (+ 7840us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.161875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.161899 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:34:52.161970 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.161975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.162136 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.162300 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:52.162628 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.163794 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.165986 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.167420 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.167553 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.167758 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.167968 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.168130 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7695,"thread_start_us":7543,"threads_started":1}
I20260809 06:34:52.170277 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.163432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:38909 (local address 127.0.0.1:32822)
0809 06:34:52.163653 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.163674 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:52.163788 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:52.164413 (+ 625us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:52.164417 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:52.164446 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:52.164864 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.164877 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.166595 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.166600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.168134 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.168147 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.169565 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.169571 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.169762 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.169794 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:34:52.169872 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 06:34:52.169995 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260809 06:34:52.170410 20500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.162698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32822 (local address 127.30.78.67:38909)
0809 06:34:52.163441 (+ 743us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.163449 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.163758 (+ 309us) server_negotiation.cc:407] Connection header received
0809 06:34:52.164005 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.164013 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.164214 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.164417 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:52.165081 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.166476 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.168308 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.169377 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.169490 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.169699 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.169943 (+ 244us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.170093 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":431,"threads_started":1}
I20260809 06:34:52.172477 19921 tablet_service.cc:1467] Processing CreateTablet for tablet a55c846233d748dea13e30459fa3a2a3 (DEFAULT_TABLE table=test-table [id=548067ed1e9c4f5e8ffd414047e2cdb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:34:52.173130 20365 tablet_service.cc:1467] Processing CreateTablet for tablet a55c846233d748dea13e30459fa3a2a3 (DEFAULT_TABLE table=test-table [id=548067ed1e9c4f5e8ffd414047e2cdb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:34:52.173874 19921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a55c846233d748dea13e30459fa3a2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:52.174253 20365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a55c846233d748dea13e30459fa3a2a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:52.181206 20501 tablet_bootstrap.cc:492] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: Bootstrap starting.
I20260809 06:34:52.184912 20501 tablet_bootstrap.cc:654] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:52.185307 20502 tablet_bootstrap.cc:492] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: Bootstrap starting.
I20260809 06:34:52.186475 20501 log.cc:824] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:52.188949 20502 tablet_bootstrap.cc:654] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:52.189416 20501 tablet_bootstrap.cc:492] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: No bootstrap required, opened a new log
I20260809 06:34:52.189770 20501 ts_tablet_manager.cc:1397] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 06:34:52.190135 20502 log.cc:824] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:52.192512 20502 tablet_bootstrap.cc:492] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: No bootstrap required, opened a new log
I20260809 06:34:52.192739 20502 ts_tablet_manager.cc:1397] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260809 06:34:52.195726 20503 tablet_bootstrap.cc:492] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: Bootstrap starting.
I20260809 06:34:52.197032 20501 raft_consensus.cc:348] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:52.197482 20501 raft_consensus.cc:374] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:52.197588 20501 raft_consensus.cc:729] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbfd9646508e43cea03b0ef4462e0dac, State: Initialized, Role: FOLLOWER
I20260809 06:34:52.198233 20501 consensus_queue.cc:260] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:52.199361 20503 tablet_bootstrap.cc:654] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:52.199370 20248 heartbeater.cc:503] Master 127.30.78.126:46301 was elected leader, sending a full tablet report...
I20260809 06:34:52.200048 20501 ts_tablet_manager.cc:1428] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260809 06:34:52.200320 20502 raft_consensus.cc:348] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:52.200618 20503 log.cc:824] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:52.200704 20502 raft_consensus.cc:374] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:52.200806 20502 raft_consensus.cc:729] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f755abfc4b4b4695ae075d94bd31686c, State: Initialized, Role: FOLLOWER
I20260809 06:34:52.201365 20502 consensus_queue.cc:260] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:52.202452 20475 heartbeater.cc:503] Master 127.30.78.126:46301 was elected leader, sending a full tablet report...
I20260809 06:34:52.203745 20503 tablet_bootstrap.cc:492] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: No bootstrap required, opened a new log
I20260809 06:34:52.203787 20502 ts_tablet_manager.cc:1428] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20260809 06:34:52.204087 20503 ts_tablet_manager.cc:1397] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.000s
I20260809 06:34:52.211905 20503 raft_consensus.cc:348] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:52.212215 20503 raft_consensus.cc:374] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:52.212285 20503 raft_consensus.cc:729] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74cad998a09c4660bc2b858635639aec, State: Initialized, Role: FOLLOWER
I20260809 06:34:52.212754 20503 consensus_queue.cc:260] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:52.214072 20503 ts_tablet_manager.cc:1428] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: Time spent starting tablet: real 0.010s user 0.003s sys 0.006s
W20260809 06:34:52.341279 20476 tablet.cc:2369] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:34:52.347280 20513 raft_consensus.cc:482] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:34:52.347576 20513 raft_consensus.cc:504] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:52.349296 20513 leader_election.cc:288] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773), f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909)
W20260809 06:34:52.350013 20250 tablet.cc:2369] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:34:52.357919 20497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.350748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:41163 (local address 127.30.78.66:38773)
0809 06:34:52.350912 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.350916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.351031 (+ 115us) server_negotiation.cc:407] Connection header received
0809 06:34:52.351239 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.351243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.351307 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.351395 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:52.352007 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.353046 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.355709 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.356908 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.357050 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.357112 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.357512 (+ 400us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.357637 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260809 06:34:52.357911 20500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.349936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:55195 (local address 127.30.78.67:38909)
0809 06:34:52.350165 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.350172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.351332 (+ 1160us) server_negotiation.cc:407] Connection header received
0809 06:34:52.351493 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.351498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.351566 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.351629 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:52.352187 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.353280 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.355692 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.356860 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.357023 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.357097 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.357512 (+ 415us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.357637 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 06:34:52.358174 20516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.349522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:38773 (local address 127.30.78.65:41163)
0809 06:34:52.350936 (+ 1414us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.350954 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:52.351106 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:52.351434 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:52.351439 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:52.351470 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:52.351865 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.351879 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.353191 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.353195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.355545 (+ 2350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.355555 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.357090 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.357095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.357309 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.357389 (+ 80us) client_negotiation.cc:769] Sending connection context
0809 06:34:52.357484 (+ 95us) client_negotiation.cc:240] Negotiation successful
0809 06:34:52.357704 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1136,"mutex_wait_us":207,"thread_start_us":1442,"threads_started":1}
I20260809 06:34:52.358197 20514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.349737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:38909 (local address 127.30.78.65:55195)
0809 06:34:52.351236 (+ 1499us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.351249 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:52.351358 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:52.351667 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:52.351672 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:52.351698 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:52.352061 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.352070 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.353404 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.353409 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.355535 (+ 2126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:52.355552 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.357072 (+ 1520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.357079 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:52.357319 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.357394 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 06:34:52.357484 (+ 90us) client_negotiation.cc:240] Negotiation successful
0809 06:34:52.357704 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1404,"mutex_wait_us":131,"thread_start_us":695,"threads_started":1}
I20260809 06:34:52.359331 20393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55c846233d748dea13e30459fa3a2a3" candidate_uuid: "74cad998a09c4660bc2b858635639aec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f755abfc4b4b4695ae075d94bd31686c" is_pre_election: true
I20260809 06:34:52.359330 20182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55c846233d748dea13e30459fa3a2a3" candidate_uuid: "74cad998a09c4660bc2b858635639aec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbfd9646508e43cea03b0ef4462e0dac" is_pre_election: true
I20260809 06:34:52.359882 20393 raft_consensus.cc:2454] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74cad998a09c4660bc2b858635639aec in term 0.
I20260809 06:34:52.359895 20182 raft_consensus.cc:2454] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74cad998a09c4660bc2b858635639aec in term 0.
I20260809 06:34:52.360574 19845 leader_election.cc:302] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74cad998a09c4660bc2b858635639aec, fbfd9646508e43cea03b0ef4462e0dac; no voters:
I20260809 06:34:52.360975 20513 raft_consensus.cc:2781] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:34:52.361107 20513 raft_consensus.cc:482] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:34:52.361193 20513 raft_consensus.cc:3037] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:52.363359 20513 raft_consensus.cc:504] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:52.363946 20513 leader_election.cc:288] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 1 election: Requested vote from peers fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773), f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909)
I20260809 06:34:52.364306 20182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55c846233d748dea13e30459fa3a2a3" candidate_uuid: "74cad998a09c4660bc2b858635639aec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbfd9646508e43cea03b0ef4462e0dac"
I20260809 06:34:52.364400 20393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a55c846233d748dea13e30459fa3a2a3" candidate_uuid: "74cad998a09c4660bc2b858635639aec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f755abfc4b4b4695ae075d94bd31686c"
I20260809 06:34:52.364473 20182 raft_consensus.cc:3037] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:52.364602 20393 raft_consensus.cc:3037] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:52.366644 20182 raft_consensus.cc:2454] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74cad998a09c4660bc2b858635639aec in term 1.
I20260809 06:34:52.366883 20393 raft_consensus.cc:2454] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74cad998a09c4660bc2b858635639aec in term 1.
I20260809 06:34:52.366991 19845 leader_election.cc:302] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74cad998a09c4660bc2b858635639aec, fbfd9646508e43cea03b0ef4462e0dac; no voters:
I20260809 06:34:52.367270 20513 raft_consensus.cc:2781] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:34:52.367674 20513 raft_consensus.cc:686] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 1 LEADER]: Becoming Leader. State: Replica: 74cad998a09c4660bc2b858635639aec, State: Running, Role: LEADER
I20260809 06:34:52.368095 20513 consensus_queue.cc:237] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:52.372578 19712 catalog_manager.cc:5495] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec reported cstate change: term changed from 0 to 1, leader changed from <none> to 74cad998a09c4660bc2b858635639aec (127.30.78.65). New cstate: current_term: 1 leader_uuid: "74cad998a09c4660bc2b858635639aec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } health_report { overall_health: UNKNOWN } } }
W20260809 06:34:52.373211 20040 tablet.cc:2369] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:34:52.411442 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.406438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47330 (local address 127.30.78.65:45609)
0809 06:34:52.406616 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.406620 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.406639 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:34:52.406750 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.406754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.406826 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.406941 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:34:52.407277 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.407963 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.409502 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.409938 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.410030 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.410466 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:34:52.410940 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:34:52.411041 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.411119 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.411182 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:34:52.419209 20182 raft_consensus.cc:1261] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [term 1 FOLLOWER]: Refusing update from remote peer 74cad998a09c4660bc2b858635639aec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:34:52.419209 20393 raft_consensus.cc:1261] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [term 1 FOLLOWER]: Refusing update from remote peer 74cad998a09c4660bc2b858635639aec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:34:52.420245 20513 consensus_queue.cc:1035] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [LEADER]: Connected to new peer: Peer: permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:34:52.420536 20517 consensus_queue.cc:1035] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:34:52.430595 20524 mvcc.cc:205] Tried to move back new op lower bound from 7316509869739270144 to 7316509869543088128. Current Snapshot: MvccSnapshot[applied={T|T < 7316509869739270144}]
I20260809 06:34:52.442413 19712 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:34:52.442663 19712 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:34:52.446053 19712 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Sending DeleteTablet for 3 replicas of tablet a55c846233d748dea13e30459fa3a2a3
I20260809 06:34:52.447149 20143 tablet_service.cc:1514] Processing DeleteTablet for tablet a55c846233d748dea13e30459fa3a2a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:34:52 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:44972
I20260809 06:34:52.447207 20365 tablet_service.cc:1514] Processing DeleteTablet for tablet a55c846233d748dea13e30459fa3a2a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:34:52 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:32822
I20260809 06:34:52.447561 19921 tablet_service.cc:1514] Processing DeleteTablet for tablet a55c846233d748dea13e30459fa3a2a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:34:52 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:47318
I20260809 06:34:52.448300 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 19819
I20260809 06:34:52.459600 20546 tablet_replica.cc:330] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: stopping tablet replica
I20260809 06:34:52.460695 20546 raft_consensus.cc:2229] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:34:52.462033 20546 raft_consensus.cc:2258] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:34:52.466059 20542 tablet_replica.cc:330] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: stopping tablet replica
I20260809 06:34:52.466527 20545 tablet_replica.cc:330] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: stopping tablet replica
I20260809 06:34:52.466495 20542 raft_consensus.cc:2229] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:34:52.466843 20545 raft_consensus.cc:2229] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:34:52.466989 20542 raft_consensus.cc:2258] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:34:52.467231 20545 raft_consensus.cc:2258] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:34:52.468358 20546 ts_tablet_manager.cc:1905] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:34:52.469581 20542 ts_tablet_manager.cc:1905] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 06:34:52 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:34:52.475775 20546 ts_tablet_manager.cc:1918] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:34:52.476153 20546 log.cc:1196] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/a55c846233d748dea13e30459fa3a2a3
I20260809 06:34:52.477211 20542 ts_tablet_manager.cc:1918] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:34:52.477456 20542 log.cc:1196] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/a55c846233d748dea13e30459fa3a2a3
I20260809 06:34:52.477578 20545 ts_tablet_manager.cc:1905] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:34:52.478066 20542 ts_tablet_manager.cc:1939] T a55c846233d748dea13e30459fa3a2a3 P fbfd9646508e43cea03b0ef4462e0dac: Deleting consensus metadata
I20260809 06:34:52.479955 19684 catalog_manager.cc:4841] TS fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773): tablet a55c846233d748dea13e30459fa3a2a3 (table test-table [id=548067ed1e9c4f5e8ffd414047e2cdb6]) successfully deleted
I20260809 06:34:52.483455 20545 ts_tablet_manager.cc:1918] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:34:52.483584 20545 log.cc:1196] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/a55c846233d748dea13e30459fa3a2a3
I20260809 06:34:52.481206 20499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.449505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47342 (local address 127.30.78.65:45609)
0809 06:34:52.452965 (+ 3460us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.452973 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.459858 (+ 6885us) server_negotiation.cc:407] Connection header received
0809 06:34:52.460130 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.460136 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.460222 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.460295 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:52.462296 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.463533 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.467394 (+ 3861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.468050 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.468184 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.473599 (+ 5415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:52.473616 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:52.473638 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:52.473682 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:52.477695 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.478669 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.478678 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.478682 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.478851 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.479304 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.479309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.479312 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.479738 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:52.480037 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.480611 (+ 574us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.480848 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3328}
I20260809 06:34:52.484196 20545 ts_tablet_manager.cc:1939] T a55c846233d748dea13e30459fa3a2a3 P f755abfc4b4b4695ae075d94bd31686c: Deleting consensus metadata
I20260809 06:34:52.484263 20546 ts_tablet_manager.cc:1939] T a55c846233d748dea13e30459fa3a2a3 P 74cad998a09c4660bc2b858635639aec: Deleting consensus metadata
I20260809 06:34:52.484411 20030 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:52.486135 19687 catalog_manager.cc:4841] TS f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909): tablet a55c846233d748dea13e30459fa3a2a3 (table test-table [id=548067ed1e9c4f5e8ffd414047e2cdb6]) successfully deleted
I20260809 06:34:52.585433 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 19819
W20260809 06:34:52.612344 19687 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.78.65:45609 (error 108)
I20260809 06:34:52.612411 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 20046
I20260809 06:34:52.614156 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.613656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47348)
0809 06:34:52.613882 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.614004 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260809 06:34:52.614418 19687 catalog_manager.cc:4584] TS 74cad998a09c4660bc2b858635639aec (127.30.78.65:45609): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a55c846233d748dea13e30459fa3a2a3: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Aug 09 06:34:52 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:34:52.626926 20497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.613220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44988 (local address 127.30.78.66:38773)
0809 06:34:52.613416 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.613422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.613447 (+ 25us) server_negotiation.cc:407] Connection header received
0809 06:34:52.613571 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.613575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.613649 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.613796 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:52.615254 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.616017 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.617401 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.617887 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.617986 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.621916 (+ 3930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:52.621928 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:52.621941 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:52.621973 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:52.624585 (+ 2612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.625213 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.625219 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.625221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.625349 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.625620 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.625623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.625625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.626089 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:52.626311 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.626546 (+ 235us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.626696 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:34:52.627544 20239 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:52.667908 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.667447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47680)
0809 06:34:52.667646 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.667731 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260809 06:34:52.669018 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.668650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47684)
0809 06:34:52.668821 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.668904 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260809 06:34:52.713954 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 20046
I20260809 06:34:52.729849 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.729125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47686)
0809 06:34:52.729394 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.729508 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 06:34:52.730933 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.730561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47700)
0809 06:34:52.730711 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.730796 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 06:34:52.736413 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 20263
Aug 09 06:34:52 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:34:52.749847 20500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.737033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40166 (local address 127.30.78.67:38909)
0809 06:34:52.737177 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:52.737182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:52.737200 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:34:52.737339 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:52.737343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:52.737415 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:52.737496 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:52.738793 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.739487 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.740672 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:52.741047 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:52.741131 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:52.745232 (+ 4101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:52.745247 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:52.745263 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:52.745300 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:52.747661 (+ 2361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.748240 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.748246 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.748248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.748372 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:52.748663 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:52.748666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:52.748668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:52.749002 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:52.749212 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:52.749421 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 06:34:52.749572 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 06:34:52.750465 20467 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:52.811491 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.811015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47706)
0809 06:34:52.811203 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.811300 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 06:34:52.812532 20498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:52.812126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47720)
0809 06:34:52.812338 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:52.812423 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260809 06:34:52.837904 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 20263
I20260809 06:34:52.865114 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 19658
I20260809 06:34:52.866247 19760 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:52.974195 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 19658
I20260809 06:34:53.002636 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:46301
--webserver_interface=127.30.78.126
--webserver_port=46591
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:46301
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:53.322507 20560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:53.322777 20560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:53.322871 20560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:53.329744 20560 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:34:53.329841 20560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:53.329893 20560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:53.329945 20560 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:34:53.329988 20560 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:34:53.339246 20560 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:46301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:46301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=46591
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:53.340366 20560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:53.341531 20560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:53.363457 20571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:53.363579 20569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:53.363446 20573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:53.364650 20560 server_base.cc:1034] running on GCE node
I20260809 06:34:53.365561 20560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:53.367147 20560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:53.368376 20560 hybrid_clock.cc:648] HybridClock initialized: now 1786257293368291 us; error 59 us; skew 500 ppm
I20260809 06:34:53.368821 20560 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:53 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257293, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:53.372403 20560 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:34:53.374130 20560 webserver.cc:460] Webserver started at http://127.30.78.126:46591/ using document root <none> and password file <none>
I20260809 06:34:53.374861 20560 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:53.374997 20560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:53.381035 20560 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 06:34:53.383931 20584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:53.385289 20560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:34:53.385442 20560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "f8c55a5cd19e4ad2add8fa34af2505b5"
format_stamp: "Formatted at 2026-08-09 06:34:50 on dist-test-slave-cvwc"
server_key: "1d96a20ff0cf1b600f752c038f134431"
server_key_iv: "63b49928cb9f8e7ae8d3e32ae0e88863"
server_key_version: "encryptionkey@0"
I20260809 06:34:53.386539 20560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:53.403833 20560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:53.407599 20560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:53.407863 20560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:53.425077 20560 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:46301
I20260809 06:34:53.425084 20663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:46301 every 8 connection(s)
I20260809 06:34:53.426504 20560 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:34:53.433099 20664 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:34:53.434103 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 20560
I20260809 06:34:53.435096 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:45609
--local_ip_for_outbound_sockets=127.30.78.65
--tserver_master_addrs=127.30.78.126:46301
--webserver_port=45975
--webserver_interface=127.30.78.65
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:34:53.437458 20664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Bootstrap starting.
I20260809 06:34:53.458236 20664 log.cc:824] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:53.470204 20664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:34:53.470700 20664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Bootstrap complete.
I20260809 06:34:53.479512 20664 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:53.480290 20664 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8c55a5cd19e4ad2add8fa34af2505b5, State: Initialized, Role: FOLLOWER
I20260809 06:34:53.480871 20664 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:53.481086 20664 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:34:53.481217 20664 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:34:53.481364 20664 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:34:53.484970 20664 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:53.485515 20664 leader_election.cc:302] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8c55a5cd19e4ad2add8fa34af2505b5; no voters:
I20260809 06:34:53.486152 20664 leader_election.cc:288] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 06:34:53.486297 20668 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 06:34:53.487511 20668 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 2 LEADER]: Becoming Leader. State: Replica: f8c55a5cd19e4ad2add8fa34af2505b5, State: Running, Role: LEADER
I20260809 06:34:53.488142 20668 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:53.488360 20664 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:34:53.491007 20670 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8c55a5cd19e4ad2add8fa34af2505b5. Latest consensus state: current_term: 2 leader_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } } }
I20260809 06:34:53.491413 20670 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:53.491422 20669 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } } }
I20260809 06:34:53.492424 20669 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:53.492966 20685 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:34:53.511035 20685 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:34:53.512521 20685 catalog_manager.cc:1259] Loaded cluster ID: 685702eb1e4d44e99a60b82d0d58c3f8
I20260809 06:34:53.512671 20685 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:34:53.516119 20685 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260809 06:34:53.535108 20685 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260809 06:34:53.557969 20685 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:34:53.559755 20685 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Loaded TSK: 0
I20260809 06:34:53.561242 20685 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 06:34:53.778543 20666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:53.778808 20666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:53.778947 20666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:53.785950 20666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:53.786057 20666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:53.786197 20666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:34:53.795724 20666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:45609
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=45975
--tserver_master_addrs=127.30.78.126:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:53.796875 20666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:53.798188 20666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:53.812374 20706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:53.812692 20705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:53.813189 20711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:53.814292 20666 server_base.cc:1034] running on GCE node
I20260809 06:34:53.814913 20666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:53.815897 20666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:53.817123 20666 hybrid_clock.cc:648] HybridClock initialized: now 1786257293817062 us; error 55 us; skew 500 ppm
I20260809 06:34:53.817437 20666 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:53 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257293, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:53.820667 20666 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:34:53.822209 20666 webserver.cc:460] Webserver started at http://127.30.78.65:45975/ using document root <none> and password file <none>
I20260809 06:34:53.822860 20666 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:53.822999 20666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:53.828118 20666 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.003s
I20260809 06:34:53.830783 20723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:53.832206 20666 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:34:53.832355 20666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "74cad998a09c4660bc2b858635639aec"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "c991813660fffdb66c8636ccc5ae6d94"
server_key_iv: "225e188ab2d423feb854912b1d29cc95"
server_key_version: "encryptionkey@0"
I20260809 06:34:53.833305 20666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:53.857146 20666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:53.861124 20666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:53.861354 20666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:53.862287 20666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:53.863627 20666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:53.863725 20666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:53.863807 20666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:53.863862 20666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:53.891821 20666 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:45609
I20260809 06:34:53.891897 20904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:45609 every 8 connection(s)
I20260809 06:34:53.893306 20666 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:34:53.901970 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 20666
I20260809 06:34:53.902563 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:38773
--local_ip_for_outbound_sockets=127.30.78.66
--tserver_master_addrs=127.30.78.126:46301
--webserver_port=40183
--webserver_interface=127.30.78.66
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:34:53 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257293, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:53.914916 20912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:53.896213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:44117)
0809 06:34:53.897036 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:53.897087 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:53.898835 (+ 1748us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:53.900020 (+ 1185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:53.900027 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:53.900498 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:53.901019 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:53.901037 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:53.902702 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:53.902706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:53.903984 (+ 1278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:53.903997 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:53.905010 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:53.905020 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:53.905313 (+ 293us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:53.905945 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:53.905968 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:53.907960 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:53.911138 (+ 3178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:53.911147 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:53.911161 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:53.911699 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:53.912114 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:53.912119 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:53.912123 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:53.912352 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:53.913124 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:53.913130 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:53.913397 (+ 267us) client_negotiation.cc:769] Sending connection context
0809 06:34:53.913604 (+ 207us) client_negotiation.cc:240] Negotiation successful
0809 06:34:53.913998 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":321,"threads_started":1}
I20260809 06:34:53.915285 20911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:53.896018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:44117 (local address 127.30.78.126:46301)
0809 06:34:53.896540 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:53.896551 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:53.897191 (+ 640us) server_negotiation.cc:407] Connection header received
0809 06:34:53.899281 (+ 2090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:53.899294 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:53.899614 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:53.899892 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:53.901195 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:53.902547 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:53.904112 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:53.904777 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:53.905023 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:53.908209 (+ 3186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:53.908217 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:53.908229 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:53.908264 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:53.910995 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:53.911837 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:53.911842 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:53.911848 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:53.912010 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:53.912451 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:53.912456 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:53.912458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:53.912999 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:53.913170 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:53.913843 (+ 673us) server_negotiation.cc:299] Negotiation successful
0809 06:34:53.914210 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":225,"threads_started":1}
I20260809 06:34:53.917908 20905 heartbeater.cc:347] Connected to a master server at 127.30.78.126:46301
I20260809 06:34:53.918197 20905 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:53.919023 20905 heartbeater.cc:511] Master 127.30.78.126:46301 requested a full tablet report, sending...
I20260809 06:34:53.921183 20612 ts_manager.cc:194] Registered new tserver with Master: 74cad998a09c4660bc2b858635639aec (127.30.78.65:45609)
I20260809 06:34:53.922654 20612 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:44117
W20260809 06:34:54.219511 20913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:54.219769 20913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:54.219913 20913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:54.226779 20913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:54.226895 20913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:54.227051 20913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:34:54.236153 20913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:38773
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=40183
--tserver_master_addrs=127.30.78.126:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:54.237423 20913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:54.238708 20913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:54.250782 20926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:54.251000 20922 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:54.250813 20921 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:54.252457 20913 server_base.cc:1034] running on GCE node
I20260809 06:34:54.253027 20913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:54.253953 20913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:54.255144 20913 hybrid_clock.cc:648] HybridClock initialized: now 1786257294255084 us; error 52 us; skew 500 ppm
I20260809 06:34:54.255430 20913 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:54 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257294, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:54.258419 20913 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:34:54.259696 20913 webserver.cc:460] Webserver started at http://127.30.78.66:40183/ using document root <none> and password file <none>
I20260809 06:34:54.260336 20913 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:54.260445 20913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:54.265404 20913 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:34:54.267938 20936 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:54.269146 20913 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:34:54.269279 20913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "fbfd9646508e43cea03b0ef4462e0dac"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "f39406a93332a9f2f42cf2058f67da7f"
server_key_iv: "06b66e7551b0e6d7fe96b7c8879b012d"
server_key_version: "encryptionkey@0"
I20260809 06:34:54.270226 20913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:54.287812 20913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:54.291671 20913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:54.291895 20913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:54.292763 20913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:54.294102 20913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:54.294186 20913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:54.294265 20913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:54.294317 20913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:54.323561 20913 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:38773
I20260809 06:34:54.323625 21142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:38773 every 8 connection(s)
I20260809 06:34:54.324900 20913 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:34:54.327752 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 20913
I20260809 06:34:54.328496 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:38909
--local_ip_for_outbound_sockets=127.30.78.67
--tserver_master_addrs=127.30.78.126:46301
--webserver_port=45867
--webserver_interface=127.30.78.67
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:34:54 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257294, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:54.343833 20911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.327187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:47305 (local address 127.30.78.126:46301)
0809 06:34:54.327349 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:54.327353 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:54.328552 (+ 1199us) server_negotiation.cc:407] Connection header received
0809 06:34:54.330471 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:54.330478 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:54.330560 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:54.330649 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:54.332099 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.332807 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.334462 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.334899 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.335011 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.338608 (+ 3597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:54.338614 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:54.338617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:54.338651 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:54.340973 (+ 2322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:54.341806 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:54.341809 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:54.341812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:54.341952 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:54.342360 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:54.342362 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:54.342364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:54.342606 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:54.342709 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:54.343436 (+ 727us) server_negotiation.cc:299] Negotiation successful
0809 06:34:54.343601 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 06:34:54.345152 21146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.327659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:47305)
0809 06:34:54.328399 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:54.328443 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:54.330184 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:54.330907 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:54.330916 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:54.331388 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:54.331923 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.331940 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.333023 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.333026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.334306 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.334319 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.335125 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.335133 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.335347 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.335979 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:54.336004 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:54.338386 (+ 2382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:54.341106 (+ 2720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:54.341114 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:54.341128 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:54.341676 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:54.342049 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:54.342053 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:54.342056 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:54.342271 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:54.342720 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:54.342726 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:54.343092 (+ 366us) client_negotiation.cc:769] Sending connection context
0809 06:34:54.343385 (+ 293us) client_negotiation.cc:240] Negotiation successful
0809 06:34:54.343885 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":309,"threads_started":1}
I20260809 06:34:54.346578 21143 heartbeater.cc:347] Connected to a master server at 127.30.78.126:46301
I20260809 06:34:54.346886 21143 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:54.347707 21143 heartbeater.cc:511] Master 127.30.78.126:46301 requested a full tablet report, sending...
I20260809 06:34:54.349200 20612 ts_manager.cc:194] Registered new tserver with Master: fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773)
I20260809 06:34:54.350312 20612 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:47305
W20260809 06:34:54.691045 21148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:54.691437 21148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:54.691599 21148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:54.703382 21148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:54.703521 21148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:54.703727 21148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:34:54.719579 21148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:38909
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=45867
--tserver_master_addrs=127.30.78.126:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:54.721438 21148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:54.723263 21148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:54.738268 21155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:54.738217 21157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:54.738385 21161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:54.739734 21148 server_base.cc:1034] running on GCE node
I20260809 06:34:54.740456 21148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:54.741588 21148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:54.742830 21148 hybrid_clock.cc:648] HybridClock initialized: now 1786257294742758 us; error 52 us; skew 500 ppm
I20260809 06:34:54.743216 21148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:54 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257294, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:54.746934 21148 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:34:54.748306 21148 webserver.cc:460] Webserver started at http://127.30.78.67:45867/ using document root <none> and password file <none>
I20260809 06:34:54.748970 21148 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:54.749089 21148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:54.754535 21148 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 06:34:54.757261 21172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:54.758673 21148 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:34:54.758826 21148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "f755abfc4b4b4695ae075d94bd31686c"
format_stamp: "Formatted at 2026-08-09 06:34:52 on dist-test-slave-cvwc"
server_key: "3e39a8f111caa5c16fd15593c9220a0b"
server_key_iv: "6f76386e94be03d1138f860ff523a45c"
server_key_version: "encryptionkey@0"
I20260809 06:34:54.759769 21148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:54.782914 21148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:54.787097 21148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:54.787340 21148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:54.788343 21148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:54.789955 21148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:54.790063 21148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:54.790174 21148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:54.790247 21148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:54.831565 21148 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:38909
I20260809 06:34:54.831674 21352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:38909 every 8 connection(s)
I20260809 06:34:54.832971 21148 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:34:54.835318 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 21148
Aug 09 06:34:54 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257294, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:34:54.872344 20911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.835865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:59839 (local address 127.30.78.126:46301)
0809 06:34:54.836084 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:54.836090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:54.851578 (+ 15488us) server_negotiation.cc:407] Connection header received
0809 06:34:54.855292 (+ 3714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:54.855300 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:54.855404 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:54.855543 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:54.858486 (+ 2943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.859686 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.861475 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.861973 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.862085 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.865990 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:54.865996 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:54.865999 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:54.866036 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:54.869142 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:54.870066 (+ 924us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:54.870069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:54.870071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:54.870186 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:54.870611 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:54.870614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:54.870616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:54.870902 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:54.871033 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:54.871720 (+ 687us) server_negotiation.cc:299] Negotiation successful
0809 06:34:54.872032 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:34:54.873426 21359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.836410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:59839)
0809 06:34:54.851371 (+ 14961us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:54.851430 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:54.854931 (+ 3501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:54.856481 (+ 1550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:54.856496 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:54.857323 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:54.858234 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.858260 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.859916 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.859920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.861333 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.861346 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.862207 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.862215 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.862459 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.863257 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:54.863292 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:54.865784 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:54.869278 (+ 3494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:54.869287 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:54.869302 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:54.869933 (+ 631us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:54.870299 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:54.870303 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:54.870306 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:54.870490 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:54.871024 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:54.871031 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:54.871339 (+ 308us) client_negotiation.cc:769] Sending connection context
0809 06:34:54.871582 (+ 243us) client_negotiation.cc:240] Negotiation successful
0809 06:34:54.872092 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14590,"thread_start_us":14358,"threads_started":1}
I20260809 06:34:54.874732 21357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.836272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57930 (local address 127.30.78.126:46301)
0809 06:34:54.859395 (+ 23123us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:54.859402 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:54.859990 (+ 588us) server_negotiation.cc:407] Connection header received
0809 06:34:54.860163 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:54.860169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:54.860243 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:54.860347 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:54.862451 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.863477 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.865393 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.866073 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.866169 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.869343 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:54.869349 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:54.869353 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:54.869388 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:54.872016 (+ 2628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:54.872713 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:54.872718 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:54.872720 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:54.872885 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:54.873217 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:54.873221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:54.873224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:54.873598 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:54.873865 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:54.874232 (+ 367us) server_negotiation.cc:299] Negotiation successful
0809 06:34:54.874411 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22990,"thread_start_us":23513,"threads_started":1}
I20260809 06:34:54.875061 21354 heartbeater.cc:347] Connected to a master server at 127.30.78.126:46301
I20260809 06:34:54.875350 21354 heartbeater.cc:464] Registering TS with master...
I20260809 06:34:54.876235 21354 heartbeater.cc:511] Master 127.30.78.126:46301 requested a full tablet report, sending...
I20260809 06:34:54.877615 20612 ts_manager.cc:194] Registered new tserver with Master: f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909)
I20260809 06:34:54.878399 20612 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:59839
I20260809 06:34:54.889479 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:34:54.896284 21357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.890411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57932 (local address 127.30.78.126:46301)
0809 06:34:54.890572 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:54.890576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:54.891101 (+ 525us) server_negotiation.cc:407] Connection header received
0809 06:34:54.891323 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:54.891326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:54.891456 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:54.891588 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:34:54.892025 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.892702 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.894239 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.894661 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.894769 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.895281 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:34:54.895723 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:34:54.895847 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:54.895968 (+ 121us) server_negotiation.cc:299] Negotiation successful
0809 06:34:54.896047 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:34:54.897085 20612 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:57932:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:34:54.904086 20612 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:34:54.926074 20905 heartbeater.cc:503] Master 127.30.78.126:46301 was elected leader, sending a full tablet report...
I20260809 06:34:54.938812 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.916051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47728 (local address 127.30.78.65:45609)
0809 06:34:54.929120 (+ 13069us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:54.929129 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:54.929160 (+ 31us) server_negotiation.cc:407] Connection header received
0809 06:34:54.929256 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:54.929264 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:54.929534 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:54.930669 (+ 1135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:54.931051 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.933420 (+ 2369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.936078 (+ 2658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.937559 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.937761 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.937996 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:54.938350 (+ 354us) server_negotiation.cc:299] Negotiation successful
0809 06:34:54.938519 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12887,"thread_start_us":13637,"threads_started":1}
I20260809 06:34:54.938827 21367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.915344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47728)
0809 06:34:54.922300 (+ 6956us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:54.922347 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:54.922502 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:54.929992 (+ 7490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:54.930001 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:54.930037 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:54.930484 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.930502 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.933533 (+ 3031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.933538 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.935916 (+ 2378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.935930 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.937874 (+ 1944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.937881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.938126 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.938165 (+ 39us) client_negotiation.cc:769] Sending connection context
0809 06:34:54.938271 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 06:34:54.938444 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6733,"thread_start_us":6561,"threads_started":1}
I20260809 06:34:54.940666 21371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.915405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:38773 (local address 127.0.0.1:36058)
0809 06:34:54.932673 (+ 17268us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:54.932691 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:54.933020 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:54.933928 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:54.933933 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:54.933967 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:54.934369 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.934382 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.936190 (+ 1808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.936195 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.938199 (+ 2004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.938214 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.939906 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.939913 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.940078 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.940102 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:34:54.940169 (+ 67us) client_negotiation.cc:240] Negotiation successful
0809 06:34:54.940281 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17145,"mutex_wait_us":21,"thread_start_us":18118,"threads_started":1}
I20260809 06:34:54.941285 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.915387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36058 (local address 127.30.78.66:38773)
0809 06:34:54.930352 (+ 14965us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:54.930361 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:54.932793 (+ 2432us) server_negotiation.cc:407] Connection header received
0809 06:34:54.933234 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:54.933243 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:54.933476 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:54.933666 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:54.934550 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.936076 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.938384 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.939695 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.939808 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.940003 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:54.940244 (+ 241us) server_negotiation.cc:299] Negotiation successful
0809 06:34:54.940957 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14790,"thread_start_us":15160,"threads_started":1}
I20260809 06:34:54.941674 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.923005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40176 (local address 127.30.78.67:38909)
0809 06:34:54.931186 (+ 8181us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:54.931195 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:54.933967 (+ 2772us) server_negotiation.cc:407] Connection header received
0809 06:34:54.934162 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:54.934168 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:54.934382 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:54.934555 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:54.935282 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.936487 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.939164 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.940472 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.940586 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.940795 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:54.941189 (+ 394us) server_negotiation.cc:299] Negotiation successful
0809 06:34:54.941360 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8020,"thread_start_us":7882,"threads_started":1}
I20260809 06:34:54.941931 21369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:54.922958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:38909 (local address 127.0.0.1:40176)
0809 06:34:54.933834 (+ 10876us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:54.933855 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:54.934001 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:54.934759 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:54.934762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:54.934785 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:54.935113 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.935120 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.936635 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.936640 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.938913 (+ 2273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:54.939008 (+ 95us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:54.940696 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:54.940703 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:54.941019 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:54.941043 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:34:54.941120 (+ 77us) client_negotiation.cc:240] Negotiation successful
0809 06:34:54.941231 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10726,"mutex_wait_us":1,"spinlock_wait_cycles":31616,"thread_start_us":9856,"threads_started":1}
I20260809 06:34:54.943427 20794 tablet_service.cc:1467] Processing CreateTablet for tablet 3e719923e64a49d68ee0d604d0fdc28b (DEFAULT_TABLE table=test-table [id=a723bc7c51d3490291f3c5ac035d38ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:34:54.944305 21028 tablet_service.cc:1467] Processing CreateTablet for tablet 3e719923e64a49d68ee0d604d0fdc28b (DEFAULT_TABLE table=test-table [id=a723bc7c51d3490291f3c5ac035d38ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:34:54.944962 20794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e719923e64a49d68ee0d604d0fdc28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:54.945390 21028 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e719923e64a49d68ee0d604d0fdc28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:54.945220 21259 tablet_service.cc:1467] Processing CreateTablet for tablet 3e719923e64a49d68ee0d604d0fdc28b (DEFAULT_TABLE table=test-table [id=a723bc7c51d3490291f3c5ac035d38ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:34:54.946532 21259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e719923e64a49d68ee0d604d0fdc28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:34:54.956702 21373 tablet_bootstrap.cc:492] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: Bootstrap starting.
I20260809 06:34:54.959781 21377 tablet_bootstrap.cc:492] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Bootstrap starting.
I20260809 06:34:54.959941 21373 tablet_bootstrap.cc:654] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:54.961604 21378 tablet_bootstrap.cc:492] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: Bootstrap starting.
I20260809 06:34:54.962309 21373 log.cc:824] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:54.963349 21377 tablet_bootstrap.cc:654] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:54.964459 21377 log.cc:824] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:54.964743 21378 tablet_bootstrap.cc:654] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: Neither blocks nor log segments found. Creating new log.
I20260809 06:34:54.965752 21373 tablet_bootstrap.cc:492] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: No bootstrap required, opened a new log
I20260809 06:34:54.965938 21378 log.cc:824] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:54.966033 21373 ts_tablet_manager.cc:1397] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260809 06:34:54.968468 21378 tablet_bootstrap.cc:492] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: No bootstrap required, opened a new log
I20260809 06:34:54.968652 21377 tablet_bootstrap.cc:492] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: No bootstrap required, opened a new log
I20260809 06:34:54.968703 21378 ts_tablet_manager.cc:1397] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260809 06:34:54.968920 21377 ts_tablet_manager.cc:1397] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260809 06:34:54.975934 21378 raft_consensus.cc:348] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:54.976280 21378 raft_consensus.cc:374] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:54.976387 21378 raft_consensus.cc:729] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f755abfc4b4b4695ae075d94bd31686c, State: Initialized, Role: FOLLOWER
I20260809 06:34:54.976748 21373 raft_consensus.cc:348] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:54.976922 21378 consensus_queue.cc:260] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:54.977145 21373 raft_consensus.cc:374] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:54.977250 21373 raft_consensus.cc:729] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbfd9646508e43cea03b0ef4462e0dac, State: Initialized, Role: FOLLOWER
I20260809 06:34:54.978022 21354 heartbeater.cc:503] Master 127.30.78.126:46301 was elected leader, sending a full tablet report...
I20260809 06:34:54.977897 21373 consensus_queue.cc:260] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:54.978613 21378 ts_tablet_manager.cc:1428] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: Time spent starting tablet: real 0.010s user 0.009s sys 0.001s
I20260809 06:34:54.978966 21143 heartbeater.cc:503] Master 127.30.78.126:46301 was elected leader, sending a full tablet report...
I20260809 06:34:54.979540 21373 ts_tablet_manager.cc:1428] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260809 06:34:54.980464 21377 raft_consensus.cc:348] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:54.980893 21377 raft_consensus.cc:374] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:34:54.980981 21377 raft_consensus.cc:729] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74cad998a09c4660bc2b858635639aec, State: Initialized, Role: FOLLOWER
I20260809 06:34:54.981519 21377 consensus_queue.cc:260] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:54.983613 21377 ts_tablet_manager.cc:1428] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
W20260809 06:34:55.076704 21145 tablet.cc:2369] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:34:55.084735 21356 tablet.cc:2369] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:34:55.145485 20909 tablet.cc:2369] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:34:55.207744 21382 raft_consensus.cc:482] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:34:55.208038 21382 raft_consensus.cc:504] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:55.209801 21382 leader_election.cc:288] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773), 74cad998a09c4660bc2b858635639aec (127.30.78.65:45609)
I20260809 06:34:55.216670 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.210180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:48889 (local address 127.30.78.66:38773)
0809 06:34:55.210510 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:55.210517 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:55.210544 (+ 27us) server_negotiation.cc:407] Connection header received
0809 06:34:55.210730 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:55.210736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:55.210817 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:55.210902 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:55.211327 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.212312 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.214694 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.215842 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.215995 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:55.216072 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:55.216305 (+ 233us) server_negotiation.cc:299] Negotiation successful
0809 06:34:55.216443 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260809 06:34:55.216797 21359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.210066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:38773 (local address 127.30.78.67:48889)
0809 06:34:55.210416 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.210436 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:55.210582 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:55.210958 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:55.210963 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:55.211011 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:55.211188 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:55.211198 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.212464 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.212467 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:55.214545 (+ 2078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:55.214561 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.216001 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.216006 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:55.216139 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:55.216165 (+ 26us) client_negotiation.cc:769] Sending connection context
0809 06:34:55.216265 (+ 100us) client_negotiation.cc:240] Negotiation successful
0809 06:34:55.216449 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"mutex_wait_us":24,"spinlock_wait_cycles":31488}
I20260809 06:34:55.217065 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.210242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:33449 (local address 127.30.78.65:45609)
0809 06:34:55.210436 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:55.210442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:55.210976 (+ 534us) server_negotiation.cc:407] Connection header received
0809 06:34:55.211109 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:55.211113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:55.211172 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:55.211241 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:34:55.211735 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.212657 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.214973 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.216139 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.216267 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:55.216333 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:55.216702 (+ 369us) server_negotiation.cc:299] Negotiation successful
0809 06:34:55.216834 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:34:55.217288 21387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.210152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.30.78.67:33449)
0809 06:34:55.210862 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.210876 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:55.210992 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:55.211280 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:55.211285 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:55.211311 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:34:55.211586 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:55.211594 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.212805 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.212810 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:55.214833 (+ 2023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:55.214844 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.216345 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.216350 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:55.216532 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:55.216564 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:34:55.216655 (+ 91us) client_negotiation.cc:240] Negotiation successful
0809 06:34:55.216772 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"mutex_wait_us":2,"thread_start_us":444,"threads_started":1}
I20260809 06:34:55.217989 21059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e719923e64a49d68ee0d604d0fdc28b" candidate_uuid: "f755abfc4b4b4695ae075d94bd31686c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbfd9646508e43cea03b0ef4462e0dac" is_pre_election: true
I20260809 06:34:55.218248 20830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e719923e64a49d68ee0d604d0fdc28b" candidate_uuid: "f755abfc4b4b4695ae075d94bd31686c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74cad998a09c4660bc2b858635639aec" is_pre_election: true
I20260809 06:34:55.218499 21059 raft_consensus.cc:2454] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f755abfc4b4b4695ae075d94bd31686c in term 0.
I20260809 06:34:55.218750 20830 raft_consensus.cc:2454] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f755abfc4b4b4695ae075d94bd31686c in term 0.
I20260809 06:34:55.219177 21173 leader_election.cc:302] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f755abfc4b4b4695ae075d94bd31686c, fbfd9646508e43cea03b0ef4462e0dac; no voters:
I20260809 06:34:55.219571 21382 raft_consensus.cc:2781] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:34:55.219707 21382 raft_consensus.cc:482] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:34:55.219795 21382 raft_consensus.cc:3037] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:55.222033 21382 raft_consensus.cc:504] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:55.222587 21382 leader_election.cc:288] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [CANDIDATE]: Term 1 election: Requested vote from peers fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773), 74cad998a09c4660bc2b858635639aec (127.30.78.65:45609)
I20260809 06:34:55.223032 21059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e719923e64a49d68ee0d604d0fdc28b" candidate_uuid: "f755abfc4b4b4695ae075d94bd31686c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbfd9646508e43cea03b0ef4462e0dac"
I20260809 06:34:55.223032 20830 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e719923e64a49d68ee0d604d0fdc28b" candidate_uuid: "f755abfc4b4b4695ae075d94bd31686c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74cad998a09c4660bc2b858635639aec"
I20260809 06:34:55.223232 21059 raft_consensus.cc:3037] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:55.223232 20830 raft_consensus.cc:3037] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:34:55.226367 21059 raft_consensus.cc:2454] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f755abfc4b4b4695ae075d94bd31686c in term 1.
I20260809 06:34:55.226367 20830 raft_consensus.cc:2454] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f755abfc4b4b4695ae075d94bd31686c in term 1.
I20260809 06:34:55.226758 21175 leader_election.cc:302] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74cad998a09c4660bc2b858635639aec, f755abfc4b4b4695ae075d94bd31686c; no voters:
I20260809 06:34:55.227094 21382 raft_consensus.cc:2781] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:34:55.227507 21382 raft_consensus.cc:686] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 1 LEADER]: Becoming Leader. State: Replica: f755abfc4b4b4695ae075d94bd31686c, State: Running, Role: LEADER
I20260809 06:34:55.228008 21382 consensus_queue.cc:237] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:55.232204 20611 catalog_manager.cc:5495] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c reported cstate change: term changed from 0 to 1, leader changed from <none> to f755abfc4b4b4695ae075d94bd31686c (127.30.78.67). New cstate: current_term: 1 leader_uuid: "f755abfc4b4b4695ae075d94bd31686c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } health_report { overall_health: HEALTHY } } }
I20260809 06:34:55.297158 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.292406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40180 (local address 127.30.78.67:38909)
0809 06:34:55.292588 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:55.292593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:55.292611 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:34:55.292699 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:55.292702 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:55.292780 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:55.292907 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:34:55.293178 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.293914 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.295290 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.295677 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.295773 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:55.296197 (+ 424us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:34:55.296686 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:34:55.296804 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:55.296841 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 06:34:55.296904 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:34:55.305275 21059 raft_consensus.cc:1261] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [term 1 FOLLOWER]: Refusing update from remote peer f755abfc4b4b4695ae075d94bd31686c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:34:55.305284 20830 raft_consensus.cc:1261] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Refusing update from remote peer f755abfc4b4b4695ae075d94bd31686c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:34:55.306401 21389 consensus_queue.cc:1035] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:34:55.306743 21382 consensus_queue.cc:1035] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [LEADER]: Connected to new peer: Peer: permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:34:55.318346 21393 mvcc.cc:205] Tried to move back new op lower bound from 7316509881559306240 to 7316509881257398272. Current Snapshot: MvccSnapshot[applied={T|T < 7316509881559306240}]
I20260809 06:34:55.333849 20611 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:57932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:34:55.334147 20611 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:57932:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:34:55.337941 20611 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Sending DeleteTablet for 3 replicas of tablet 3e719923e64a49d68ee0d604d0fdc28b
I20260809 06:34:55.339205 21028 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e719923e64a49d68ee0d604d0fdc28b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:34:55 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:36058
I20260809 06:34:55.339349 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 20666
I20260809 06:34:55.340355 21259 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e719923e64a49d68ee0d604d0fdc28b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:34:55 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:40176
I20260809 06:34:55.340478 20794 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e719923e64a49d68ee0d604d0fdc28b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:34:55 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:47728
I20260809 06:34:55.346787 21408 tablet_replica.cc:330] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: stopping tablet replica
I20260809 06:34:55.350934 21408 raft_consensus.cc:2229] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:34:55.351881 21408 raft_consensus.cc:2258] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:34:55.354110 21410 tablet_replica.cc:330] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: stopping tablet replica
I20260809 06:34:55.354561 21408 ts_tablet_manager.cc:1905] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:34:55.354597 21410 raft_consensus.cc:2229] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:34:55.355276 21410 raft_consensus.cc:2258] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:34:55.355999 21412 tablet_replica.cc:330] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: stopping tablet replica
I20260809 06:34:55.358260 21412 raft_consensus.cc:2229] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:34:55.358852 21412 raft_consensus.cc:2258] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:34:55.359086 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.340187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47730 (local address 127.30.78.65:45609)
0809 06:34:55.341006 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:55.341012 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:55.341031 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:34:55.341085 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:55.341090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:55.341183 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:55.341304 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:55.343047 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.344199 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.346180 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.346804 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.346927 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:55.350550 (+ 3623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:55.350565 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:55.350583 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:55.350627 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:55.354646 (+ 4019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:55.355588 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:55.355597 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:55.355601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:55.355800 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:55.356290 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:55.356295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:55.356299 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:55.356768 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:55.358214 (+ 1446us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:55.358400 (+ 186us) server_negotiation.cc:299] Negotiation successful
0809 06:34:55.358642 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704}
I20260809 06:34:55.357743 21410 ts_tablet_manager.cc:1905] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:34:55.359881 20897 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:55.362815 21408 ts_tablet_manager.cc:1918] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:34:55.363016 21408 log.cc:1196] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/3e719923e64a49d68ee0d604d0fdc28b
I20260809 06:34:55.363608 21408 ts_tablet_manager.cc:1939] T 3e719923e64a49d68ee0d604d0fdc28b P fbfd9646508e43cea03b0ef4462e0dac: Deleting consensus metadata
I20260809 06:34:55.365502 20585 catalog_manager.cc:4841] TS fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773): tablet 3e719923e64a49d68ee0d604d0fdc28b (table test-table [id=a723bc7c51d3490291f3c5ac035d38ff]) successfully deleted
I20260809 06:34:55.367370 21410 ts_tablet_manager.cc:1918] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:34:55.367563 21410 log.cc:1196] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/3e719923e64a49d68ee0d604d0fdc28b
I20260809 06:34:55.368166 21410 ts_tablet_manager.cc:1939] T 3e719923e64a49d68ee0d604d0fdc28b P f755abfc4b4b4695ae075d94bd31686c: Deleting consensus metadata
I20260809 06:34:55.369920 20589 catalog_manager.cc:4841] TS f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909): tablet 3e719923e64a49d68ee0d604d0fdc28b (table test-table [id=a723bc7c51d3490291f3c5ac035d38ff]) successfully deleted
I20260809 06:34:55.459012 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 20666
W20260809 06:34:55.477664 20589 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.78.65:45609 (error 108)
I20260809 06:34:55.477954 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 20913
I20260809 06:34:55.479876 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.479068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47732)
0809 06:34:55.479514 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.479643 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":227,"threads_started":1}
W20260809 06:34:55.481143 20589 catalog_manager.cc:4584] TS 74cad998a09c4660bc2b858635639aec (127.30.78.65:45609): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3e719923e64a49d68ee0d604d0fdc28b: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
I20260809 06:34:55.493507 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.478790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36068 (local address 127.30.78.66:38773)
0809 06:34:55.478973 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:55.478979 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:55.479067 (+ 88us) server_negotiation.cc:407] Connection header received
0809 06:34:55.479345 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:55.479352 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:55.479438 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:55.479549 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:55.481092 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.482327 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.483678 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.484316 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.484442 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:55.486929 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:55.486946 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:55.486964 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:55.487004 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:55.490685 (+ 3681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:55.491395 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:55.491405 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:55.491409 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:55.491571 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:55.491899 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:55.491904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:55.491908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:55.492382 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:55.492681 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:55.492849 (+ 168us) server_negotiation.cc:299] Negotiation successful
0809 06:34:55.493087 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:34:55.494217 21134 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:55.534917 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.534370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47734)
0809 06:34:55.534603 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.534724 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 06:34:55.536141 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.535703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47742)
0809 06:34:55.535878 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.535970 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 06:34:55.581511 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 20913
I20260809 06:34:55.597126 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.596599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47756)
0809 06:34:55.596838 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.596947 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260809 06:34:55.598402 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.597944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47758)
0809 06:34:55.598121 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.598219 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 06:34:55.604537 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 21148
I20260809 06:34:55.618609 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.605212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40190 (local address 127.30.78.67:38909)
0809 06:34:55.605372 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:55.605378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:55.605528 (+ 150us) server_negotiation.cc:407] Connection header received
0809 06:34:55.605757 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:55.605761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:55.605848 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:55.605946 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:55.607261 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.608045 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.609357 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:55.609933 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:55.610069 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:55.612540 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:55.612552 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:55.612566 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:55.612604 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:55.615760 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:55.616468 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:55.616475 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:55.616477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:55.616640 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:55.616990 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:55.616996 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:55.616999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:55.617374 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:55.617670 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:55.618034 (+ 364us) server_negotiation.cc:299] Negotiation successful
0809 06:34:55.618248 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260809 06:34:55.619413 21345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:55.679020 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.678544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47762)
0809 06:34:55.678742 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.678839 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 06:34:55.680049 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.679653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47778)
0809 06:34:55.679841 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.679920 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 06:34:55.740356 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 21148
I20260809 06:34:55.765275 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 20560
I20260809 06:34:55.766383 20659 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:34:55.877373 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:55.876638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:45609 (local address 127.0.0.1:47786)
0809 06:34:55.877090 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:55.877191 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:45609: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294}
I20260809 06:34:55.877344 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 20560
I20260809 06:34:55.904541 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:46301
--webserver_interface=127.30.78.126
--webserver_port=46591
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:46301
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:56.224609 21428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:56.224906 21428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:56.225035 21428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:56.232026 21428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:34:56.232129 21428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:56.232208 21428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:56.232285 21428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:34:56.232347 21428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:34:56.241689 21428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:46301
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:46301
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=46591
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:56.242957 21428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:56.244210 21428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:56.255396 21442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:56.255519 21438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:56.255734 21437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:56.256520 21428 server_base.cc:1034] running on GCE node
I20260809 06:34:56.257251 21428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:56.258597 21428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:56.259794 21428 hybrid_clock.cc:648] HybridClock initialized: now 1786257296259725 us; error 60 us; skew 500 ppm
I20260809 06:34:56.260113 21428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:56 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257296, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:56.263051 21428 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:34:56.264393 21428 webserver.cc:460] Webserver started at http://127.30.78.126:46591/ using document root <none> and password file <none>
I20260809 06:34:56.265002 21428 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:56.265101 21428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:56.270174 21428 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:34:56.272729 21455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:56.274003 21428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:34:56.274150 21428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "f8c55a5cd19e4ad2add8fa34af2505b5"
format_stamp: "Formatted at 2026-08-09 06:34:50 on dist-test-slave-cvwc"
server_key: "1d96a20ff0cf1b600f752c038f134431"
server_key_iv: "63b49928cb9f8e7ae8d3e32ae0e88863"
server_key_version: "encryptionkey@0"
I20260809 06:34:56.275043 21428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:56.288887 21428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:56.292361 21428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:56.292593 21428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:56.309232 21428 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:46301
I20260809 06:34:56.309257 21552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:46301 every 8 connection(s)
I20260809 06:34:56.310555 21428 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:34:56.317039 21555 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:34:56.317310 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 21428
I20260809 06:34:56.318326 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:45609
--local_ip_for_outbound_sockets=127.30.78.65
--tserver_master_addrs=127.30.78.126:46301
--webserver_port=45975
--webserver_interface=127.30.78.65
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:34:56.321308 21555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Bootstrap starting.
I20260809 06:34:56.342343 21555 log.cc:824] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:56.357873 21555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:34:56.358353 21555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5: Bootstrap complete.
I20260809 06:34:56.366983 21555 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:56.367796 21555 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8c55a5cd19e4ad2add8fa34af2505b5, State: Initialized, Role: FOLLOWER
I20260809 06:34:56.368402 21555 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:56.368604 21555 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:34:56.368710 21555 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:34:56.368873 21555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 2 FOLLOWER]: Advancing to term 3
I20260809 06:34:56.372520 21555 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:56.372989 21555 leader_election.cc:302] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8c55a5cd19e4ad2add8fa34af2505b5; no voters:
I20260809 06:34:56.373588 21555 leader_election.cc:288] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 06:34:56.373746 21561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 06:34:56.374816 21561 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [term 3 LEADER]: Becoming Leader. State: Replica: f8c55a5cd19e4ad2add8fa34af2505b5, State: Running, Role: LEADER
I20260809 06:34:56.375396 21561 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } }
I20260809 06:34:56.375708 21555 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:34:56.377707 21563 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8c55a5cd19e4ad2add8fa34af2505b5. Latest consensus state: current_term: 3 leader_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } } }
I20260809 06:34:56.378245 21563 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:56.377877 21562 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8c55a5cd19e4ad2add8fa34af2505b5" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 46301 } } }
I20260809 06:34:56.379060 21562 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8c55a5cd19e4ad2add8fa34af2505b5 [sys.catalog]: This master's current role is: LEADER
I20260809 06:34:56.381444 21568 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:34:56.390236 21568 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:34:56.391779 21568 catalog_manager.cc:1259] Loaded cluster ID: 685702eb1e4d44e99a60b82d0d58c3f8
I20260809 06:34:56.391922 21568 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260809 06:34:56.394047 21568 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f4eeb86d9ad google::LogMessage::Fail() at ??:0
@ 0x7f4eeb87088a google::LogMessage::SendToLog() at ??:0
I20260809 06:34:56.400667 21586 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f4eeb86d4de google::LogMessage::Flush() at ??:0
@ 0x7f4eeb86ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4f012a0512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f4f0129d976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f4f01325610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f4f01325439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f4eee4b9345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4eee4bc91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f4eee4bc799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f4eee497eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f4ef17716db start_thread at ??:0
@ 0x7f4eea70761f clone at ??:0
W20260809 06:34:56.668181 21558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:56.668453 21558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:56.668599 21558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:56.675716 21558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:56.675827 21558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:56.675979 21558 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:34:56.685392 21558 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:45609
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=45975
--tserver_master_addrs=127.30.78.126:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:56.686596 21558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:56.687840 21558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:56.700227 21616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:56.700176 21617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:56.700265 21621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:56.701084 21558 server_base.cc:1034] running on GCE node
I20260809 06:34:56.701627 21558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:56.702486 21558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:56.703672 21558 hybrid_clock.cc:648] HybridClock initialized: now 1786257296703628 us; error 37 us; skew 500 ppm
I20260809 06:34:56.703944 21558 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:56 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257296, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:56.706877 21558 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:34:56.708149 21558 webserver.cc:460] Webserver started at http://127.30.78.65:45975/ using document root <none> and password file <none>
I20260809 06:34:56.708773 21558 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:56.708891 21558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:56.713835 21558 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260809 06:34:56.718540 21635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:56.719733 21558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:34:56.719877 21558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "74cad998a09c4660bc2b858635639aec"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "c991813660fffdb66c8636ccc5ae6d94"
server_key_iv: "225e188ab2d423feb854912b1d29cc95"
server_key_version: "encryptionkey@0"
I20260809 06:34:56.720767 21558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:56.756624 21558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:56.760285 21558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:56.760535 21558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:56.761480 21558 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:56.763270 21643 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260809 06:34:56.769028 21558 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260809 06:34:56.769140 21558 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260809 06:34:56.769245 21558 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260809 06:34:56.772310 21558 ts_tablet_manager.cc:610] Registered 1 tablets
I20260809 06:34:56.772397 21558 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20260809 06:34:56.772711 21643 tablet_bootstrap.cc:492] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Bootstrap starting.
I20260809 06:34:56.780682 21643 log.cc:824] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Log is configured to *not* fsync() on all Append() calls
I20260809 06:34:56.796962 21643 tablet_bootstrap.cc:492] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:34:56.797837 21643 tablet_bootstrap.cc:492] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Bootstrap complete.
I20260809 06:34:56.798372 21643 ts_tablet_manager.cc:1397] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Time spent bootstrapping tablet: real 0.026s user 0.016s sys 0.008s
I20260809 06:34:56.806102 21558 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:45609
I20260809 06:34:56.806136 21833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:45609 every 8 connection(s)
I20260809 06:34:56.807588 21558 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:34:56.809370 21643 raft_consensus.cc:348] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:56.810405 21643 raft_consensus.cc:729] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74cad998a09c4660bc2b858635639aec, State: Initialized, Role: FOLLOWER
I20260809 06:34:56.811002 21643 consensus_queue.cc:260] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:56.812367 21837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:56.810195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:54989)
0809 06:34:56.811198 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:56.811519 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":512,"threads_started":1}
I20260809 06:34:56.812449 21643 ts_tablet_manager.cc:1428] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec: Time spent starting tablet: real 0.014s user 0.009s sys 0.005s
W20260809 06:34:56.812909 21834 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:46301 (0 consecutive failures): Network error: Failed to ping master at 127.30.78.126:46301: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
I20260809 06:34:56.813607 21837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:56.813332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:55521)
0809 06:34:56.813449 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:56.813512 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 06:34:56.814335 21837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:56.814063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:51909)
0809 06:34:56.814163 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:56.814229 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260809 06:34:56.814527 21834 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 06:34:56.816560 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 21558
I20260809 06:34:56.817178 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:38773
--local_ip_for_outbound_sockets=127.30.78.66
--tserver_master_addrs=127.30.78.126:46301
--webserver_port=40183
--webserver_interface=127.30.78.66
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:34:57.133221 21840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:57.133471 21840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:57.133600 21840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:57.140424 21840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:57.140517 21840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:57.140674 21840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:34:57.149650 21840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:38773
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=40183
--tserver_master_addrs=127.30.78.126:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:57.150763 21840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:57.151993 21840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:57.164098 21849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:57.164026 21852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:57.164068 21854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:57.165155 21840 server_base.cc:1034] running on GCE node
I20260809 06:34:57.165735 21840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:57.166584 21840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:57.167780 21840 hybrid_clock.cc:648] HybridClock initialized: now 1786257297167741 us; error 27 us; skew 500 ppm
I20260809 06:34:57.168066 21840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:57 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257297, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:57.174153 21840 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:34:57.175448 21840 webserver.cc:460] Webserver started at http://127.30.78.66:40183/ using document root <none> and password file <none>
I20260809 06:34:57.176117 21840 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:57.176234 21840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:57.181201 21840 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:34:57.183679 21868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:57.184861 21840 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:34:57.185020 21840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "fbfd9646508e43cea03b0ef4462e0dac"
format_stamp: "Formatted at 2026-08-09 06:34:51 on dist-test-slave-cvwc"
server_key: "f39406a93332a9f2f42cf2058f67da7f"
server_key_iv: "06b66e7551b0e6d7fe96b7c8879b012d"
server_key_version: "encryptionkey@0"
I20260809 06:34:57.185992 21840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:57.209764 21840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:57.213377 21840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:57.213616 21840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:57.214679 21840 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:57.215977 21840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:57.216074 21840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:57.216178 21840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:57.216260 21840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:57.245461 21840 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:38773
I20260809 06:34:57.245563 22061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:38773 every 8 connection(s)
I20260809 06:34:57.246865 21840 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:34:57.249569 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 21840
I20260809 06:34:57.250205 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:38909
--local_ip_for_outbound_sockets=127.30.78.67
--tserver_master_addrs=127.30.78.126:46301
--webserver_port=45867
--webserver_interface=127.30.78.67
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:38197
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:34:57.251827 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:57.249862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:49317)
0809 06:34:57.250661 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:57.250939 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":314,"threads_started":1}
W20260809 06:34:57.252465 22062 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:46301 (0 consecutive failures): Network error: Failed to ping master at 127.30.78.126:46301: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
I20260809 06:34:57.253311 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:57.252966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:43791)
0809 06:34:57.253139 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:57.253206 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260809 06:34:57.254137 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:57.253821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:50011)
0809 06:34:57.253947 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:57.254029 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 06:34:57.254349 22062 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:34:57.565418 22068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:34:57.565677 22068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:34:57.565846 22068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:34:57.572822 22068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:34:57.572925 22068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:34:57.573071 22068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:34:57.582651 22068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38197
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:38909
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=45867
--tserver_master_addrs=127.30.78.126:46301
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:34:57.583912 22068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:34:57.585147 22068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:34:57.597642 22074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:57.597549 22075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:34:57.597589 22079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:34:57.598343 22068 server_base.cc:1034] running on GCE node
I20260809 06:34:57.598934 22068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:34:57.599792 22068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:34:57.601002 22068 hybrid_clock.cc:648] HybridClock initialized: now 1786257297600955 us; error 29 us; skew 500 ppm
I20260809 06:34:57.601294 22068 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:34:57 dist-test-slave-cvwc krb5kdc[19638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257297, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:34:57.604310 22068 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:34:57.605566 22068 webserver.cc:460] Webserver started at http://127.30.78.67:45867/ using document root <none> and password file <none>
I20260809 06:34:57.606221 22068 fs_manager.cc:359] Metadata directory not provided
I20260809 06:34:57.606336 22068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:34:57.611241 22068 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:34:57.613786 22099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:57.615005 22068 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:34:57.615154 22068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "f755abfc4b4b4695ae075d94bd31686c"
format_stamp: "Formatted at 2026-08-09 06:34:52 on dist-test-slave-cvwc"
server_key: "3e39a8f111caa5c16fd15593c9220a0b"
server_key_iv: "6f76386e94be03d1138f860ff523a45c"
server_key_version: "encryptionkey@0"
I20260809 06:34:57.616070 22068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:34:57.639194 22068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:34:57.642750 22068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:34:57.642984 22068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:34:57.643886 22068 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:34:57.645160 22068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:34:57.645264 22068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:57.645370 22068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:34:57.645440 22068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:34:57.674410 22068 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:38909
I20260809 06:34:57.674506 22308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:38909 every 8 connection(s)
I20260809 06:34:57.675817 22068 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:34:57.680263 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:57.678533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:39893)
0809 06:34:57.679218 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:57.679434 (+ 216us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":258,"threads_started":1}
W20260809 06:34:57.680923 22309 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:46301 (0 consecutive failures): Network error: Failed to ping master at 127.30.78.126:46301: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
I20260809 06:34:57.681648 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:57.681336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:56607)
0809 06:34:57.681477 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:57.681543 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 06:34:57.682433 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:57.682136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:51737)
0809 06:34:57.682249 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:57.682321 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 06:34:57.682652 22309 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 06:34:57.684983 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 22068
I20260809 06:34:57.815770 22319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:57.814955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:37357)
0809 06:34:57.815399 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:57.815535 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":195,"threads_started":1}
I20260809 06:34:58.195644 22323 raft_consensus.cc:482] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:34:58.195932 22323 raft_consensus.cc:504] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:34:58.197561 22323 leader_election.cc:288] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773), f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909)
Aug 09 06:34:58 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257296, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
Aug 09 06:34:58 dist-test-slave-cvwc krb5kdc[19638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257296, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:34:58.218398 22319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:58.197705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:38773 (local address 127.30.78.65:49439)
0809 06:34:58.197997 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:58.198053 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:58.198654 (+ 601us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:58.202301 (+ 3647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:58.202312 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:58.203169 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:58.204080 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:58.204101 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:58.205599 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:58.205603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:58.207041 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:58.207054 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:58.208036 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:58.208045 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:58.208231 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:58.208955 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:58.208972 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:58.211663 (+ 2691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:58.214944 (+ 3281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:58.214953 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:58.214967 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:58.215538 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:58.215950 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:58.215954 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:58.215956 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:58.216113 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:58.216902 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:58.216907 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:58.217167 (+ 260us) client_negotiation.cc:769] Sending connection context
0809 06:34:58.217387 (+ 220us) client_negotiation.cc:240] Negotiation successful
0809 06:34:58.217938 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":211,"spinlock_wait_cycles":46976}
I20260809 06:34:58.218412 22327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:58.198136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:35771 (local address 127.30.78.67:38909)
0809 06:34:58.199919 (+ 1783us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:58.199935 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:58.200326 (+ 391us) server_negotiation.cc:407] Connection header received
0809 06:34:58.201836 (+ 1510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:58.201847 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:58.202202 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:58.202547 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:58.204262 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:58.205407 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:58.207163 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:58.207787 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:58.207959 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:58.211565 (+ 3606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:58.211576 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:58.211594 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:58.211638 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:58.214816 (+ 3178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:58.215614 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:58.215622 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:58.215630 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:58.215784 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:58.216228 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:58.216232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:58.216234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:58.216751 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:58.216909 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:58.217636 (+ 727us) server_negotiation.cc:299] Negotiation successful
0809 06:34:58.218023 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1607,"thread_start_us":1481,"threads_started":1}
I20260809 06:34:58.218518 22325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:58.197949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:38909 (local address 127.30.78.65:35771)
0809 06:34:58.200218 (+ 2269us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:58.200235 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:34:58.200359 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:34:58.202525 (+ 2166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:34:58.202528 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:34:58.203201 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:34:58.204080 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:58.204101 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:58.205592 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:58.205595 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:58.207035 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:34:58.207047 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:34:58.207989 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:34:58.207996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:34:58.208233 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:58.208892 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:34:58.208922 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:34:58.211277 (+ 2355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:34:58.214945 (+ 3668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:58.214955 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:58.214967 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:58.215481 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:58.215895 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:34:58.215900 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:34:58.215903 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:34:58.216117 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:34:58.216876 (+ 759us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:34:58.216883 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:34:58.217165 (+ 282us) client_negotiation.cc:769] Sending connection context
0809 06:34:58.217388 (+ 223us) client_negotiation.cc:240] Negotiation successful
0809 06:34:58.218095 (+ 707us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2141,"mutex_wait_us":327,"spinlock_wait_cycles":52736,"thread_start_us":1965,"threads_started":1}
I20260809 06:34:58.218425 22326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:58.198022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:49439 (local address 127.30.78.66:38773)
0809 06:34:58.199554 (+ 1532us) server_negotiation.cc:206] Beginning negotiation
0809 06:34:58.199573 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0809 06:34:58.199618 (+ 45us) server_negotiation.cc:407] Connection header received
0809 06:34:58.201330 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:34:58.201342 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:34:58.201816 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:34:58.202110 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:34:58.204269 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:58.205406 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:58.207176 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:34:58.207787 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:34:58.207961 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:34:58.211899 (+ 3938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:34:58.211906 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:34:58.211917 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:34:58.211951 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:34:58.214805 (+ 2854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:58.215662 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:58.215667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:58.215672 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:58.215823 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:34:58.216226 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:34:58.216229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:34:58.216231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:34:58.216769 (+ 538us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:34:58.216950 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0809 06:34:58.217651 (+ 701us) server_negotiation.cc:299] Negotiation successful
0809 06:34:58.218023 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1335,"thread_start_us":1224,"threads_started":1}
W20260809 06:34:58.221570 21638 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
W20260809 06:34:58.221840 21636 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
I20260809 06:34:58.221962 21636 leader_election.cc:302] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74cad998a09c4660bc2b858635639aec; no voters: f755abfc4b4b4695ae075d94bd31686c, fbfd9646508e43cea03b0ef4462e0dac
I20260809 06:34:58.222340 22323 raft_consensus.cc:2726] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 06:34:58.255563 22329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:58.254753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:52349)
0809 06:34:58.255190 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:58.255331 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":214,"threads_started":1}
I20260809 06:34:58.683898 22330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:58.683088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:49989)
0809 06:34:58.683529 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:58.683672 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":207,"threads_started":1}
I20260809 06:34:58.817200 22331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:58.816567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:39509)
0809 06:34:58.816975 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:58.817050 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":204,"threads_started":1}
I20260809 06:34:59.257118 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:59.256391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:49535)
0809 06:34:59.256880 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:59.256963 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":269,"threads_started":1}
I20260809 06:34:59.685235 22333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:59.684630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:58159)
0809 06:34:59.685010 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:59.685089 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":203,"threads_started":1}
I20260809 06:34:59.818617 22334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:34:59.817939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:38835)
0809 06:34:59.818355 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0809 06:34:59.818434 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":197,"threads_started":1}
I20260809 06:35:00.181083 22335 raft_consensus.cc:482] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:35:00.181303 22335 raft_consensus.cc:504] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:35:00.182058 22335 leader_election.cc:288] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773), f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909)
W20260809 06:35:00.183172 21636 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
W20260809 06:35:00.183394 21638 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
I20260809 06:35:00.183574 21638 leader_election.cc:302] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74cad998a09c4660bc2b858635639aec; no voters: f755abfc4b4b4695ae075d94bd31686c, fbfd9646508e43cea03b0ef4462e0dac
I20260809 06:35:00.183828 22335 raft_consensus.cc:2726] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 06:35:00.258719 22336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:00.258012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:44497)
0809 06:35:00.258485 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:00.258563 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":250,"threads_started":1}
I20260809 06:35:00.686614 22338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:00.685984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:60457)
0809 06:35:00.686374 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:00.686461 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":194,"threads_started":1}
I20260809 06:35:00.820053 22339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:00.819402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:50449)
0809 06:35:00.819792 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:00.819869 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":206,"threads_started":1}
I20260809 06:35:01.260203 22342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:01.259523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:35937)
0809 06:35:01.259943 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:01.260022 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":204,"threads_started":1}
I20260809 06:35:01.687995 22343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:01.687342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:32905)
0809 06:35:01.687749 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:01.687824 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":204,"threads_started":1}
I20260809 06:35:01.821656 22346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:01.820966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:53065)
0809 06:35:01.821398 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:01.821480 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":203,"threads_started":1}
I20260809 06:35:02.261773 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:02.261039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:34115)
0809 06:35:02.261488 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:02.261571 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":227,"threads_started":1}
I20260809 06:35:02.689414 22348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:02.688757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:38655)
0809 06:35:02.689174 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:02.689249 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":237,"threads_started":1}
I20260809 06:35:02.823150 22350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:02.822510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:59023)
0809 06:35:02.822913 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:02.822992 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":208,"threads_started":1}
I20260809 06:35:03.263303 22351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:03.262588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:36201)
0809 06:35:03.263048 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:03.263128 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":232,"threads_started":1}
I20260809 06:35:03.292275 22352 raft_consensus.cc:482] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:35:03.292469 22352 raft_consensus.cc:504] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:35:03.293099 22352 leader_election.cc:288] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773), f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909)
W20260809 06:35:03.293985 21636 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
W20260809 06:35:03.294144 21638 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
I20260809 06:35:03.294262 21638 leader_election.cc:302] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74cad998a09c4660bc2b858635639aec; no voters: f755abfc4b4b4695ae075d94bd31686c, fbfd9646508e43cea03b0ef4462e0dac
I20260809 06:35:03.294476 22352 raft_consensus.cc:2726] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 06:35:03.690989 22353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:03.690216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:35103)
0809 06:35:03.690745 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:03.690821 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":308,"threads_started":1}
I20260809 06:35:03.824556 22354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:03.823887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:56959)
0809 06:35:03.824279 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:03.824356 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":201,"threads_started":1}
I20260809 06:35:04.264861 22356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:04.264120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:50875)
0809 06:35:04.264602 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:04.264681 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":218,"threads_started":1}
I20260809 06:35:04.692590 22357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:04.691797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:58267)
0809 06:35:04.692319 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:04.692411 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":260,"threads_started":1}
I20260809 06:35:04.825984 22358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:04.825309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:49161)
0809 06:35:04.825735 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:04.825819 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":217,"threads_started":1}
I20260809 06:35:05.266381 22359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:05.265652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:35825)
0809 06:35:05.266115 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:05.266195 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":255,"threads_started":1}
I20260809 06:35:05.694078 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:05.693380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:48655)
0809 06:35:05.693813 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:05.693899 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":215,"threads_started":1}
I20260809 06:35:05.827400 22366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:05.826699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:33111)
0809 06:35:05.827135 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:05.827221 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":226,"threads_started":1}
I20260809 06:35:06.267971 22367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:06.267243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:38829)
0809 06:35:06.267727 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:06.267817 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":234,"threads_started":1}
I20260809 06:35:06.695501 22368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:06.694850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:45269)
0809 06:35:06.695272 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:06.695357 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":200,"threads_started":1}
I20260809 06:35:06.828868 22369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:06.828206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:60613)
0809 06:35:06.828629 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:06.828708 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":231,"threads_started":1}
I20260809 06:35:07.269574 22371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:07.268802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:38923)
0809 06:35:07.269281 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:07.269370 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":251,"threads_started":1}
I20260809 06:35:07.404426 22372 raft_consensus.cc:482] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:35:07.404611 22372 raft_consensus.cc:504] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:35:07.405275 22372 leader_election.cc:288] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773), f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909)
W20260809 06:35:07.406235 21638 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
W20260809 06:35:07.406423 21636 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
I20260809 06:35:07.406524 21636 leader_election.cc:302] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74cad998a09c4660bc2b858635639aec; no voters: f755abfc4b4b4695ae075d94bd31686c, fbfd9646508e43cea03b0ef4462e0dac
I20260809 06:35:07.406754 22372 raft_consensus.cc:2726] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 06:35:07.696928 22373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:07.696287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:59041)
0809 06:35:07.696677 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:07.696759 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":204,"threads_started":1}
I20260809 06:35:07.830454 22374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:07.829655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:36945)
0809 06:35:07.830132 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:07.830256 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":235,"threads_started":1}
I20260809 06:35:08.271098 22376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:08.270406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:44453)
0809 06:35:08.270856 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:08.270942 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":212,"threads_started":1}
I20260809 06:35:08.698410 22377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:08.697700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:54147)
0809 06:35:08.698165 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:08.698246 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":204,"threads_started":1}
I20260809 06:35:08.831817 22378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:08.831168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:37335)
0809 06:35:08.831582 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:08.831660 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":226,"threads_started":1}
I20260809 06:35:09.272658 22380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:09.271944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:51233)
0809 06:35:09.272401 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:09.272483 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":234,"threads_started":1}
I20260809 06:35:09.699939 22381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:09.699256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:57305)
0809 06:35:09.699693 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:09.699769 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":242,"threads_started":1}
I20260809 06:35:09.833271 22384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:09.832572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:37677)
0809 06:35:09.833003 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:09.833082 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":229,"threads_started":1}
I20260809 06:35:10.274183 22385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:10.273475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:60077)
0809 06:35:10.273930 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:10.274020 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":243,"threads_started":1}
I20260809 06:35:10.701403 22388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:10.700733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:43169)
0809 06:35:10.701159 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:10.701249 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":218,"threads_started":1}
I20260809 06:35:10.834710 22389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:10.834046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:51317)
0809 06:35:10.834446 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:10.834529 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":215,"threads_started":1}
I20260809 06:35:10.992895 22390 raft_consensus.cc:482] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:35:10.993081 22390 raft_consensus.cc:504] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbfd9646508e43cea03b0ef4462e0dac" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 38773 } } peers { permanent_uuid: "74cad998a09c4660bc2b858635639aec" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 45609 } } peers { permanent_uuid: "f755abfc4b4b4695ae075d94bd31686c" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38909 } }
I20260809 06:35:10.993745 22390 leader_election.cc:288] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773), f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909)
W20260809 06:35:10.994666 21636 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fbfd9646508e43cea03b0ef4462e0dac (127.30.78.66:38773): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
W20260809 06:35:10.994845 21638 leader_election.cc:341] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f755abfc4b4b4695ae075d94bd31686c (127.30.78.67:38909): Not found: Tablet not found: 3e719923e64a49d68ee0d604d0fdc28b
I20260809 06:35:10.994972 21638 leader_election.cc:302] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74cad998a09c4660bc2b858635639aec; no voters: f755abfc4b4b4695ae075d94bd31686c, fbfd9646508e43cea03b0ef4462e0dac
I20260809 06:35:10.995208 22390 raft_consensus.cc:2726] T 3e719923e64a49d68ee0d604d0fdc28b P 74cad998a09c4660bc2b858635639aec [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260809 06:35:11.275919 22393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:11.275125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:60103)
0809 06:35:11.275602 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:11.275696 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":226,"threads_started":1}
I20260809 06:35:11.703034 22394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:11.702257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:56679)
0809 06:35:11.702749 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:11.702840 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":248,"threads_started":1}
I20260809 06:35:11.836514 22395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:11.835776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.65:49777)
0809 06:35:11.836225 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:11.836324 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":209,"threads_started":1}
I20260809 06:35:12.277704 22396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:12.276961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.66:54743)
0809 06:35:12.277426 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:12.277525 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":231,"threads_started":1}
I20260809 06:35:12.687696 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 21558
I20260809 06:35:12.702282 22397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:12.688681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51764 (local address 127.30.78.65:45609)
0809 06:35:12.689279 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:12.689289 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:12.689323 (+ 34us) server_negotiation.cc:407] Connection header received
0809 06:35:12.689412 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:12.689421 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:12.689746 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:12.689895 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:12.691989 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:12.692993 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:12.694226 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:12.694751 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:12.694842 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:12.697328 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:12.697341 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:12.697355 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:12.697387 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:12.699918 (+ 2531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:12.700528 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:12.700535 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:12.700537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:12.700662 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:12.700935 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:12.700938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:12.700940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:12.701273 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:12.701497 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:12.701702 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 06:35:12.701951 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":318,"threads_started":1}
I20260809 06:35:12.703540 21829 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:12.704937 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:12.704100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:46301 (local address 127.30.78.67:39119)
0809 06:35:12.704634 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:12.704753 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:46301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":229,"threads_started":1}
I20260809 06:35:12.790769 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 21558
I20260809 06:35:12.814910 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 21840
I20260809 06:35:12.827735 22402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:12.815601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43198 (local address 127.30.78.66:38773)
0809 06:35:12.816075 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:12.816080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:12.816095 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:35:12.816148 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:12.816151 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:12.816205 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:12.816297 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:12.817681 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:12.818703 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:12.820235 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:12.820672 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:12.820762 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:12.823302 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:12.823307 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:12.823310 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:12.823342 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:12.825632 (+ 2290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:12.826232 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:12.826236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:12.826239 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:12.826369 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:12.826658 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:12.826661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:12.826663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:12.826899 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:12.827081 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:12.827265 (+ 184us) server_negotiation.cc:299] Negotiation successful
0809 06:35:12.827446 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":240,"threads_started":1}
I20260809 06:35:12.828398 22054 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:12.910185 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 21840
I20260809 06:35:12.932680 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 22068
I20260809 06:35:12.945142 22406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:12.933397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48688 (local address 127.30.78.67:38909)
0809 06:35:12.933961 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:12.933966 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:12.933986 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:35:12.934044 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:12.934048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:12.934116 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:12.934204 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:12.935616 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:12.936376 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:12.937550 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:12.938040 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:12.938129 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:12.940457 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:12.940462 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:12.940465 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:12.940494 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:12.943016 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:12.943594 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:12.943597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:12.943599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:12.943736 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:12.944004 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:12.944007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:12.944009 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:12.944237 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:12.944419 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:12.944622 (+ 203us) server_negotiation.cc:299] Negotiation successful
0809 06:35:12.944781 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":250,"threads_started":1}
I20260809 06:35:12.945814 22304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:13.026325 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 22068
2026-08-09T06:35:13Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24351 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:35:13 dist-test-slave-cvwc krb5kdc[22412](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:35:13 dist-test-slave-cvwc krb5kdc[22412](info): set up 2 sockets
Aug 09 06:35:13 dist-test-slave-cvwc krb5kdc[22412](info): commencing operation
krb5kdc: starting...
W20260809 06:35:14.234792 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.001s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:35:14 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:35:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:35:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:35:14.467306 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33845
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:33845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:35:14.788230 22433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:35:14.788657 22433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:35:14.788786 22433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:35:14.795881 22433 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 06:35:14.795969 22433 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 06:35:14.796027 22433 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 06:35:14.796096 22433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:35:14.796161 22433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:35:14.796253 22433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:35:14.796308 22433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:35:14.796388 22433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:35:14.805965 22433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:33845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:35:14.807116 22433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:35:14.808377 22433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:35:14.819830 22442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:14.819788 22445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:14.819790 22443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:35:14.820734 22433 server_base.cc:1034] running on GCE node
I20260809 06:35:14.821448 22433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:35:14.822779 22433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:35:14.823990 22433 hybrid_clock.cc:648] HybridClock initialized: now 1786257314823930 us; error 39 us; skew 500 ppm
I20260809 06:35:14.824290 22433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:35:14 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257314, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:35:14.827282 22433 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:35:14.828658 22433 webserver.cc:460] Webserver started at http://127.30.78.126:43761/ using document root <none> and password file <none>
I20260809 06:35:14.829337 22433 fs_manager.cc:359] Metadata directory not provided
I20260809 06:35:14.829448 22433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:35:14.829763 22433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:35:14.832616 22433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "54e4e9f49fd047f98fb75ca88fa14d55"
format_stamp: "Formatted at 2026-08-09 06:35:14 on dist-test-slave-cvwc"
server_key: "4b04c6f7c16af1530f09756c7d5314a3"
server_key_iv: "6711004b06385af112c6f9ab2cfd343b"
server_key_version: "encryptionkey@0"
I20260809 06:35:14.833350 22433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "54e4e9f49fd047f98fb75ca88fa14d55"
format_stamp: "Formatted at 2026-08-09 06:35:14 on dist-test-slave-cvwc"
server_key: "4b04c6f7c16af1530f09756c7d5314a3"
server_key_iv: "6711004b06385af112c6f9ab2cfd343b"
server_key_version: "encryptionkey@0"
I20260809 06:35:14.838152 22433 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.002s
I20260809 06:35:14.841331 22457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:14.842576 22433 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:35:14.842726 22433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "54e4e9f49fd047f98fb75ca88fa14d55"
format_stamp: "Formatted at 2026-08-09 06:35:14 on dist-test-slave-cvwc"
server_key: "4b04c6f7c16af1530f09756c7d5314a3"
server_key_iv: "6711004b06385af112c6f9ab2cfd343b"
server_key_version: "encryptionkey@0"
I20260809 06:35:14.842911 22433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:35:14.873497 22433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:35:14.878310 22433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:35:14.878572 22433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:35:14.895416 22433 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:33845
I20260809 06:35:14.895457 22538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:33845 every 8 connection(s)
I20260809 06:35:14.896648 22433 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:35:14.900182 22539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:35:14.900246 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 22433
I20260809 06:35:14.900446 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:35:14.901070 31033 external_mini_cluster.cc:1428] Setting key 612eecddeb40db7925235f4657793e89
I20260809 06:35:14.913009 22539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Bootstrap starting.
Aug 09 06:35:14 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:35:14.916481 22539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Neither blocks nor log segments found. Creating new log.
I20260809 06:35:14.917757 22539 log.cc:824] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Log is configured to *not* fsync() on all Append() calls
I20260809 06:35:14.920939 22539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: No bootstrap required, opened a new log
I20260809 06:35:14.925009 22545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:14.902925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55728 (local address 127.30.78.126:33845)
0809 06:35:14.903693 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:14.903704 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:14.903747 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:35:14.905697 (+ 1950us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:14.905752 (+ 55us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:14.906116 (+ 364us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:14.906434 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:14.908158 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:14.909411 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:14.911286 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:14.911906 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:14.912022 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:14.916797 (+ 4775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:14.916814 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:14.916835 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:14.916884 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:14.920622 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:14.921316 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:14.921328 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:14.921337 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:14.921557 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:14.921942 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:14.921947 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:14.921951 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:14.922624 (+ 673us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:14.922942 (+ 318us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:14.923240 (+ 298us) server_negotiation.cc:299] Negotiation successful
0809 06:35:14.923683 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":558,"thread_start_us":330,"threads_started":1}
I20260809 06:35:14.929579 22539 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:35:14.930006 22539 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:35:14.930094 22539 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e4e9f49fd047f98fb75ca88fa14d55, State: Initialized, Role: FOLLOWER
I20260809 06:35:14.930562 22539 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:35:14.930760 22539 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:35:14.930853 22539 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:35:14.930997 22539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:35:14.933203 22539 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:35:14.933645 22539 leader_election.cc:302] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54e4e9f49fd047f98fb75ca88fa14d55; no voters:
I20260809 06:35:14.934177 22539 leader_election.cc:288] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:35:14.934289 22548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:35:14.934878 22548 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 1 LEADER]: Becoming Leader. State: Replica: 54e4e9f49fd047f98fb75ca88fa14d55, State: Running, Role: LEADER
I20260809 06:35:14.935410 22548 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:35:14.936007 22539 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:35:14.938033 22549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } } }
I20260809 06:35:14.938432 22549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: This master's current role is: LEADER
I20260809 06:35:14.938308 22550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54e4e9f49fd047f98fb75ca88fa14d55. Latest consensus state: current_term: 1 leader_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } } }
I20260809 06:35:14.938632 22550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: This master's current role is: LEADER
I20260809 06:35:14.939576 22562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:35:14.944573 22562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:35:14.952513 22562 catalog_manager.cc:1347] Generated new cluster ID: de5458f61ad64144b28769ae00e14bb5
I20260809 06:35:14.952623 22562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:35:14.960374 22562 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:35:14.962113 22562 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:35:14.972414 22562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Generated new TSK 0
I20260809 06:35:14.973353 22562 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:35:15.034586 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33845
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:35:15.352743 22586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:35:15.352998 22586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:35:15.353127 22586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:35:15.360038 22586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:35:15.360146 22586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:35:15.360293 22586 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:35:15.370010 22586 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:35:15.371196 22586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:35:15.372447 22586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:35:15.385208 22596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:15.385221 22598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:15.385234 22594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:35:15.385854 22586 server_base.cc:1034] running on GCE node
I20260809 06:35:15.386443 22586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:35:15.387266 22586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:35:15.388460 22586 hybrid_clock.cc:648] HybridClock initialized: now 1786257315388422 us; error 28 us; skew 500 ppm
I20260809 06:35:15.388741 22586 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:35:15 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257315, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:35:15.395139 22586 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:35:15.396484 22586 webserver.cc:460] Webserver started at http://127.30.78.65:38385/ using document root <none> and password file <none>
I20260809 06:35:15.397118 22586 fs_manager.cc:359] Metadata directory not provided
I20260809 06:35:15.397231 22586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:35:15.397508 22586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:35:15.400256 22586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "fb1e67cb516c4be8b7df2591fcc5cc50"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "b19b14fe35e4390b6748929a6180aa26"
server_key_iv: "5a9e2c285ae0b6dd2ef993c540049654"
server_key_version: "encryptionkey@0"
I20260809 06:35:15.400977 22586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "fb1e67cb516c4be8b7df2591fcc5cc50"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "b19b14fe35e4390b6748929a6180aa26"
server_key_iv: "5a9e2c285ae0b6dd2ef993c540049654"
server_key_version: "encryptionkey@0"
I20260809 06:35:15.405620 22586 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:35:15.408802 22608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:15.410032 22586 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 06:35:15.410175 22586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "fb1e67cb516c4be8b7df2591fcc5cc50"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "b19b14fe35e4390b6748929a6180aa26"
server_key_iv: "5a9e2c285ae0b6dd2ef993c540049654"
server_key_version: "encryptionkey@0"
I20260809 06:35:15.410341 22586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:35:15.428937 22586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:35:15.432297 22586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:35:15.432533 22586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:35:15.433360 22586 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:35:15.434594 22586 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:35:15.434669 22586 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:15.434783 22586 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:35:15.434835 22586 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:15.464578 22586 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:38663
I20260809 06:35:15.464623 22789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:38663 every 8 connection(s)
I20260809 06:35:15.465792 22586 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:35:15.467799 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 22586
I20260809 06:35:15.468024 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:35:15.468849 31033 external_mini_cluster.cc:1428] Setting key 9bb13ed41fce13214d62b8b04baa800c
Aug 09 06:35:15 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257315, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:35:15.490406 22801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:15.474752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:33547 (local address 127.30.78.126:33845)
0809 06:35:15.475180 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:15.475185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:15.475201 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:35:15.475252 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:15.475256 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:15.475316 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:15.475408 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:15.477818 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:15.478782 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:15.480479 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:15.481025 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:15.481156 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:15.484527 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:15.484533 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:15.484538 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:15.484578 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:15.487387 (+ 2809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:15.488230 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:15.488233 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:15.488236 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:15.488355 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:15.488766 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:15.488769 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:15.488771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:15.489030 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:15.489137 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:15.489960 (+ 823us) server_negotiation.cc:299] Negotiation successful
0809 06:35:15.490132 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":748,"threads_started":1}
I20260809 06:35:15.491762 22798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:15.469247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:33547)
0809 06:35:15.470541 (+ 1294us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:15.470600 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:15.472938 (+ 2338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:15.475747 (+ 2809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:15.475762 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:15.476672 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:35:15.477619 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:15.477643 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:15.478970 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:15.478976 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:15.480326 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:15.480339 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:15.481234 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:15.481239 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:15.481439 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:15.482082 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:35:15.482108 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:35:15.484292 (+ 2184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:35:15.487527 (+ 3235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:15.487537 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:15.487553 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:15.488129 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:15.488447 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:15.488451 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:15.488455 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:15.488677 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:15.489143 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:35:15.489151 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:35:15.489561 (+ 410us) client_negotiation.cc:769] Sending connection context
0809 06:35:15.489862 (+ 301us) client_negotiation.cc:240] Negotiation successful
0809 06:35:15.490426 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":992,"thread_start_us":722,"threads_started":1}
I20260809 06:35:15.493289 22790 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33845
I20260809 06:35:15.493608 22790 heartbeater.cc:464] Registering TS with master...
I20260809 06:35:15.494484 22790 heartbeater.cc:511] Master 127.30.78.126:33845 requested a full tablet report, sending...
I20260809 06:35:15.496842 22486 ts_manager.cc:194] Registered new tserver with Master: fb1e67cb516c4be8b7df2591fcc5cc50 (127.30.78.65:38663)
I20260809 06:35:15.498855 22486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:33547
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:35:15.532404 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33845
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:35:15.843878 22805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:35:15.844139 22805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:35:15.844244 22805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:35:15.851174 22805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:35:15.851267 22805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:35:15.851384 22805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:35:15.860425 22805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:35:15.861554 22805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:35:15.862816 22805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:35:15.875484 22814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:15.875634 22816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:15.875550 22819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:35:15.876197 22805 server_base.cc:1034] running on GCE node
I20260809 06:35:15.876806 22805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:35:15.877681 22805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:35:15.878901 22805 hybrid_clock.cc:648] HybridClock initialized: now 1786257315878851 us; error 41 us; skew 500 ppm
I20260809 06:35:15.879184 22805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:35:15 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257315, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:35:15.882154 22805 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:35:15.883469 22805 webserver.cc:460] Webserver started at http://127.30.78.66:41971/ using document root <none> and password file <none>
I20260809 06:35:15.884111 22805 fs_manager.cc:359] Metadata directory not provided
I20260809 06:35:15.884225 22805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:35:15.884511 22805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:35:15.887315 22805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "bb573b579f3b416e9d3062303fc4d7f7"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "2b7f29ae5aaf56fe6821bfe4c1de81a2"
server_key_iv: "33eb7e9316e3078d07233bb5b5caea2c"
server_key_version: "encryptionkey@0"
I20260809 06:35:15.888022 22805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "bb573b579f3b416e9d3062303fc4d7f7"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "2b7f29ae5aaf56fe6821bfe4c1de81a2"
server_key_iv: "33eb7e9316e3078d07233bb5b5caea2c"
server_key_version: "encryptionkey@0"
I20260809 06:35:15.892800 22805 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:35:15.896262 22833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:15.897563 22805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260809 06:35:15.897730 22805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "bb573b579f3b416e9d3062303fc4d7f7"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "2b7f29ae5aaf56fe6821bfe4c1de81a2"
server_key_iv: "33eb7e9316e3078d07233bb5b5caea2c"
server_key_version: "encryptionkey@0"
I20260809 06:35:15.897909 22805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:35:15.912106 22805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:35:15.915722 22805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:35:15.915963 22805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:35:15.916781 22805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:35:15.917991 22805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:35:15.918062 22805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:15.918175 22805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:35:15.918229 22805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:15.947074 22805 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:41143
I20260809 06:35:15.947171 23018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:41143 every 8 connection(s)
I20260809 06:35:15.948298 22805 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:35:15.952605 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 22805
I20260809 06:35:15.952778 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:35:15.953223 31033 external_mini_cluster.cc:1428] Setting key 0155038470857cd4420b95ceebf4ab88
Aug 09 06:35:15 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257315, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:35:15.966544 22801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:15.950575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:50801 (local address 127.30.78.126:33845)
0809 06:35:15.950750 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:15.950754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:15.951860 (+ 1106us) server_negotiation.cc:407] Connection header received
0809 06:35:15.953668 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:15.953674 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:15.953785 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:15.953885 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:15.955278 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:15.955989 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:15.957481 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:15.957948 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:15.958054 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:15.961351 (+ 3297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:15.961356 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:15.961359 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:15.961397 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:15.963700 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:15.964350 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:15.964354 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:15.964357 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:15.964487 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:15.964888 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:15.964893 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:15.964895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:15.965166 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:15.965293 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:15.965969 (+ 676us) server_negotiation.cc:299] Negotiation successful
0809 06:35:15.966191 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:35:15.967411 23021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:15.951012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:50801)
0809 06:35:15.951714 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:15.951757 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:15.953416 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:15.954108 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:15.954115 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:15.954606 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:35:15.955123 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:15.955139 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:15.956135 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:15.956138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:15.957340 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:15.957352 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:15.958170 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:15.958178 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:15.958388 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:15.958996 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:35:15.959016 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:35:15.961148 (+ 2132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:35:15.963827 (+ 2679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:15.963836 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:15.963851 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:15.964240 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:15.964602 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:15.964605 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:15.964608 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:15.964783 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:15.965297 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:35:15.965305 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:35:15.965596 (+ 291us) client_negotiation.cc:769] Sending connection context
0809 06:35:15.965845 (+ 249us) client_negotiation.cc:240] Negotiation successful
0809 06:35:15.966331 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":278,"threads_started":1}
I20260809 06:35:15.968802 23019 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33845
I20260809 06:35:15.969084 23019 heartbeater.cc:464] Registering TS with master...
I20260809 06:35:15.969825 23019 heartbeater.cc:511] Master 127.30.78.126:33845 requested a full tablet report, sending...
I20260809 06:35:15.971206 22486 ts_manager.cc:194] Registered new tserver with Master: bb573b579f3b416e9d3062303fc4d7f7 (127.30.78.66:41143)
I20260809 06:35:15.971971 22486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:50801
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:35:16.008193 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33845
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:35:16.362651 23029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:35:16.362905 23029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:35:16.363011 23029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:35:16.370002 23029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:35:16.370098 23029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:35:16.370244 23029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:35:16.379884 23029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:35:16.381138 23029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:35:16.382527 23029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:35:16.394833 23047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:16.394870 23043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:16.395083 23042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:35:16.395905 23029 server_base.cc:1034] running on GCE node
I20260809 06:35:16.396458 23029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:35:16.397293 23029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:35:16.398495 23029 hybrid_clock.cc:648] HybridClock initialized: now 1786257316398443 us; error 27 us; skew 500 ppm
I20260809 06:35:16.398774 23029 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:35:16 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257316, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:35:16.401760 23029 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:35:16.403088 23029 webserver.cc:460] Webserver started at http://127.30.78.67:38863/ using document root <none> and password file <none>
I20260809 06:35:16.403717 23029 fs_manager.cc:359] Metadata directory not provided
I20260809 06:35:16.403833 23029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:35:16.404119 23029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:35:16.406870 23029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "e2da1a5e2cc547b5a3831a76a9dec4af"
format_stamp: "Formatted at 2026-08-09 06:35:16 on dist-test-slave-cvwc"
server_key: "9c49f3f04c573d67a72b5536ad85c6c5"
server_key_iv: "1f13443189cf659e27deb7e42214c5c2"
server_key_version: "encryptionkey@0"
I20260809 06:35:16.407594 23029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "e2da1a5e2cc547b5a3831a76a9dec4af"
format_stamp: "Formatted at 2026-08-09 06:35:16 on dist-test-slave-cvwc"
server_key: "9c49f3f04c573d67a72b5536ad85c6c5"
server_key_iv: "1f13443189cf659e27deb7e42214c5c2"
server_key_version: "encryptionkey@0"
I20260809 06:35:16.412281 23029 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:35:16.415573 23056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:16.416720 23029 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:35:16.416867 23029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "e2da1a5e2cc547b5a3831a76a9dec4af"
format_stamp: "Formatted at 2026-08-09 06:35:16 on dist-test-slave-cvwc"
server_key: "9c49f3f04c573d67a72b5536ad85c6c5"
server_key_iv: "1f13443189cf659e27deb7e42214c5c2"
server_key_version: "encryptionkey@0"
I20260809 06:35:16.417033 23029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:35:16.430250 23029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:35:16.434074 23029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:35:16.434320 23029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:35:16.435153 23029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:35:16.436365 23029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:35:16.436452 23029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:16.436565 23029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:35:16.436623 23029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:16.467152 23029 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:34131
I20260809 06:35:16.467186 23264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:34131 every 8 connection(s)
I20260809 06:35:16.468537 23029 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:35:16.470715 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 23029
I20260809 06:35:16.470898 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:35:16.471419 31033 external_mini_cluster.cc:1428] Setting key b663d9da667d174d8d017f1c87afecef
Aug 09 06:35:16 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257316, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:35:16.487643 23267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.470961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:37857 (local address 127.30.78.126:33845)
0809 06:35:16.473324 (+ 2363us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:16.473328 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:16.473346 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:35:16.474953 (+ 1607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:16.474957 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:16.475019 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:16.475108 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:16.476463 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.477228 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.478706 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.479089 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.479176 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.482297 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:16.482302 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:16.482305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:16.482335 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:16.484674 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:16.485442 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:16.485447 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:16.485451 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:16.485598 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:16.486078 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:16.486081 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:16.486083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:16.486423 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:16.486569 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:16.487218 (+ 649us) server_negotiation.cc:299] Negotiation successful
0809 06:35:16.487384 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2268,"thread_start_us":2158,"threads_started":1}
I20260809 06:35:16.488480 23272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.471554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:37857)
0809 06:35:16.472626 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:16.472711 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:16.474720 (+ 2009us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:16.475288 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:16.475295 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:16.475793 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:35:16.476327 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.476344 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.477337 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.477340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.478590 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.478602 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.479247 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.479252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.479442 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.480047 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:35:16.480069 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:35:16.482108 (+ 2039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:35:16.484808 (+ 2700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:16.484814 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:16.484825 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:16.485315 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:16.485702 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:16.485707 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:16.485710 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:16.485957 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:16.486546 (+ 589us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:35:16.486551 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:35:16.486914 (+ 363us) client_negotiation.cc:769] Sending connection context
0809 06:35:16.487120 (+ 206us) client_negotiation.cc:240] Negotiation successful
0809 06:35:16.487479 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":753,"thread_start_us":513,"threads_started":1}
I20260809 06:35:16.489665 23265 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33845
I20260809 06:35:16.489971 23265 heartbeater.cc:464] Registering TS with master...
I20260809 06:35:16.490650 23265 heartbeater.cc:511] Master 127.30.78.126:33845 requested a full tablet report, sending...
I20260809 06:35:16.491935 22486 ts_manager.cc:194] Registered new tserver with Master: e2da1a5e2cc547b5a3831a76a9dec4af (127.30.78.67:34131)
I20260809 06:35:16.492690 22486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:37857
I20260809 06:35:16.498497 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:35:16.501699 22790 heartbeater.cc:503] Master 127.30.78.126:33845 was elected leader, sending a full tablet report...
I20260809 06:35:16.515329 23267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.503179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55742 (local address 127.30.78.126:33845)
0809 06:35:16.503332 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:16.503336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:16.503798 (+ 462us) server_negotiation.cc:407] Connection header received
0809 06:35:16.503971 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:16.503976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:16.504047 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:16.504126 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:16.505608 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.506351 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.507674 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.508077 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.508188 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.510628 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:16.510633 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:16.510637 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:16.510665 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:16.512818 (+ 2153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:16.513431 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:16.513436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:16.513440 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:16.513560 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:16.513948 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:16.513953 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:16.513957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:16.514281 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:16.514501 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:16.514804 (+ 303us) server_negotiation.cc:299] Negotiation successful
0809 06:35:16.515034 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 06:35:16.518636 22486 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55742:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:35:16.525516 22486 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:35:16.556247 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.536799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40840 (local address 127.30.78.65:38663)
0809 06:35:16.548454 (+ 11655us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:16.548464 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:16.548493 (+ 29us) server_negotiation.cc:407] Connection header received
0809 06:35:16.548592 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:16.548600 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:16.548846 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:16.549041 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:16.550178 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.551590 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.554000 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.555148 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.555284 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.555514 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:16.555759 (+ 245us) server_negotiation.cc:299] Negotiation successful
0809 06:35:16.555922 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11477,"thread_start_us":13147,"threads_started":1}
I20260809 06:35:16.556233 23288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.536516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38663 (local address 127.0.0.1:40840)
0809 06:35:16.546729 (+ 10213us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:16.546770 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:16.546953 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:16.549327 (+ 2374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:16.549336 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:16.549369 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:16.549814 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.549827 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.551751 (+ 1924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.551756 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.553845 (+ 2089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.553862 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.555324 (+ 1462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.555331 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.555506 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.555558 (+ 52us) client_negotiation.cc:769] Sending connection context
0809 06:35:16.555682 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 06:35:16.555859 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9962,"thread_start_us":12097,"threads_started":1}
I20260809 06:35:16.556962 23287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.536760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41143 (local address 127.0.0.1:59186)
0809 06:35:16.548875 (+ 12115us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:16.548892 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:16.549007 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:16.550021 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:16.550026 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:16.550056 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:16.550464 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.550476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.552393 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.552398 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.554433 (+ 2035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.554448 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.556164 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.556170 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.556344 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.556380 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:35:16.556444 (+ 64us) client_negotiation.cc:240] Negotiation successful
0809 06:35:16.556553 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11991,"mutex_wait_us":3,"thread_start_us":9555,"threads_started":1}
I20260809 06:35:16.557735 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.537899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46796 (local address 127.30.78.67:34131)
0809 06:35:16.548461 (+ 10562us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:16.548470 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:16.550303 (+ 1833us) server_negotiation.cc:407] Connection header received
0809 06:35:16.550476 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:16.550483 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:16.550676 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:16.550854 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:16.551449 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.552964 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.555145 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.556468 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.556593 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.556806 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:16.557353 (+ 547us) server_negotiation.cc:299] Negotiation successful
0809 06:35:16.557471 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9352,"thread_start_us":9199,"threads_started":1}
I20260809 06:35:16.558176 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.537251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59186 (local address 127.30.78.66:41143)
0809 06:35:16.549487 (+ 12236us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:16.549493 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:16.549516 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:35:16.549593 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:16.549598 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:16.549789 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:16.550635 (+ 846us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:16.550802 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.552242 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.554585 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.555928 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.557443 (+ 1515us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.557619 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:16.557686 (+ 67us) server_negotiation.cc:299] Negotiation successful
0809 06:35:16.557859 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12106,"thread_start_us":11984,"threads_started":1}
I20260809 06:35:16.558427 23293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.537215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:34131 (local address 127.0.0.1:46796)
0809 06:35:16.550183 (+ 12968us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:16.550204 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:16.550329 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:16.550861 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:16.550866 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:16.550891 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:16.551262 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.551274 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.553108 (+ 1834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.553114 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.555004 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.555016 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.556962 (+ 1946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.556968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.557128 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.557160 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:35:16.557972 (+ 812us) client_negotiation.cc:240] Negotiation successful
0809 06:35:16.558063 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12841,"mutex_wait_us":41,"thread_start_us":12699,"threads_started":1}
I20260809 06:35:16.560685 22685 tablet_service.cc:1467] Processing CreateTablet for tablet 2f46f798dc7441efb0e22320eafb2911 (DEFAULT_TABLE table=test-table [id=0f28e0f6b785446b81295bb671805360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:35:16.561954 22685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f46f798dc7441efb0e22320eafb2911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:35:16.561472 22908 tablet_service.cc:1467] Processing CreateTablet for tablet 2f46f798dc7441efb0e22320eafb2911 (DEFAULT_TABLE table=test-table [id=0f28e0f6b785446b81295bb671805360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:35:16.561830 23140 tablet_service.cc:1467] Processing CreateTablet for tablet 2f46f798dc7441efb0e22320eafb2911 (DEFAULT_TABLE table=test-table [id=0f28e0f6b785446b81295bb671805360]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:35:16.563244 23140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f46f798dc7441efb0e22320eafb2911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:35:16.563796 22908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2f46f798dc7441efb0e22320eafb2911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:35:16.572769 23297 tablet_bootstrap.cc:492] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: Bootstrap starting.
I20260809 06:35:16.576282 23300 tablet_bootstrap.cc:492] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: Bootstrap starting.
I20260809 06:35:16.576459 23297 tablet_bootstrap.cc:654] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: Neither blocks nor log segments found. Creating new log.
I20260809 06:35:16.577521 23297 log.cc:824] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: Log is configured to *not* fsync() on all Append() calls
I20260809 06:35:16.577968 23301 tablet_bootstrap.cc:492] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: Bootstrap starting.
I20260809 06:35:16.579680 23300 tablet_bootstrap.cc:654] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: Neither blocks nor log segments found. Creating new log.
I20260809 06:35:16.580876 23300 log.cc:824] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: Log is configured to *not* fsync() on all Append() calls
I20260809 06:35:16.580935 23301 tablet_bootstrap.cc:654] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: Neither blocks nor log segments found. Creating new log.
I20260809 06:35:16.581837 23297 tablet_bootstrap.cc:492] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: No bootstrap required, opened a new log
I20260809 06:35:16.582084 23297 ts_tablet_manager.cc:1397] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260809 06:35:16.582058 23301 log.cc:824] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: Log is configured to *not* fsync() on all Append() calls
I20260809 06:35:16.584337 23301 tablet_bootstrap.cc:492] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: No bootstrap required, opened a new log
I20260809 06:35:16.584331 23300 tablet_bootstrap.cc:492] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: No bootstrap required, opened a new log
I20260809 06:35:16.584575 23301 ts_tablet_manager.cc:1397] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260809 06:35:16.584602 23300 ts_tablet_manager.cc:1397] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260809 06:35:16.592096 23301 raft_consensus.cc:348] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } }
I20260809 06:35:16.592432 23301 raft_consensus.cc:374] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:35:16.592561 23301 raft_consensus.cc:729] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb573b579f3b416e9d3062303fc4d7f7, State: Initialized, Role: FOLLOWER
I20260809 06:35:16.592716 23297 raft_consensus.cc:348] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } }
I20260809 06:35:16.593160 23297 raft_consensus.cc:374] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:35:16.593098 23301 consensus_queue.cc:260] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } }
I20260809 06:35:16.593281 23297 raft_consensus.cc:729] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb1e67cb516c4be8b7df2591fcc5cc50, State: Initialized, Role: FOLLOWER
I20260809 06:35:16.593906 23297 consensus_queue.cc:260] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } }
I20260809 06:35:16.594300 23019 heartbeater.cc:503] Master 127.30.78.126:33845 was elected leader, sending a full tablet report...
I20260809 06:35:16.594944 23301 ts_tablet_manager.cc:1428] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: Time spent starting tablet: real 0.010s user 0.008s sys 0.002s
I20260809 06:35:16.595408 23300 raft_consensus.cc:348] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } }
I20260809 06:35:16.595944 23300 raft_consensus.cc:374] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:35:16.596103 23300 raft_consensus.cc:729] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2da1a5e2cc547b5a3831a76a9dec4af, State: Initialized, Role: FOLLOWER
I20260809 06:35:16.596598 23297 ts_tablet_manager.cc:1428] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260809 06:35:16.596884 23300 consensus_queue.cc:260] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } }
I20260809 06:35:16.598034 23265 heartbeater.cc:503] Master 127.30.78.126:33845 was elected leader, sending a full tablet report...
I20260809 06:35:16.598729 23300 ts_tablet_manager.cc:1428] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: Time spent starting tablet: real 0.014s user 0.005s sys 0.009s
W20260809 06:35:16.700125 23020 tablet.cc:2369] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:35:16.718392 22791 tablet.cc:2369] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:35:16.720093 23266 tablet.cc:2369] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:35:16.889037 23308 raft_consensus.cc:482] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:35:16.889323 23308 raft_consensus.cc:504] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } }
I20260809 06:35:16.891009 23308 leader_election.cc:288] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fb1e67cb516c4be8b7df2591fcc5cc50 (127.30.78.65:38663), e2da1a5e2cc547b5a3831a76a9dec4af (127.30.78.67:34131)
I20260809 06:35:16.897930 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.891588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:42667 (local address 127.30.78.67:34131)
0809 06:35:16.891760 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:16.891766 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:16.892406 (+ 640us) server_negotiation.cc:407] Connection header received
0809 06:35:16.892545 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:16.892549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:16.892610 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:16.892698 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:16.893342 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.894172 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.896048 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.897017 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.897166 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.897241 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:16.897535 (+ 294us) server_negotiation.cc:299] Negotiation successful
0809 06:35:16.897660 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260809 06:35:16.898048 23314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.891442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:34131 (local address 127.30.78.66:42667)
0809 06:35:16.892288 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:16.892302 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:16.892421 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:16.892729 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:16.892733 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:16.892757 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:16.893186 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.893195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.894293 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.894299 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.895887 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.895899 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.897210 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.897215 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.897373 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.897407 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:35:16.897490 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 06:35:16.897616 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"mutex_wait_us":53,"thread_start_us":530,"threads_started":1}
I20260809 06:35:16.898736 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.891525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:45279 (local address 127.30.78.65:38663)
0809 06:35:16.891759 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:16.891766 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:16.892268 (+ 502us) server_negotiation.cc:407] Connection header received
0809 06:35:16.892489 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:16.892495 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:16.892567 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:16.892633 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:16.893303 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.894185 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.896515 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.897588 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.897747 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.897816 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:16.898363 (+ 547us) server_negotiation.cc:299] Negotiation successful
0809 06:35:16.898510 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 06:35:16.898806 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.891214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38663 (local address 127.30.78.66:45279)
0809 06:35:16.892149 (+ 935us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:16.892164 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:16.892318 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:16.892677 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:16.892683 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:16.892707 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:16.893146 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.893155 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.894310 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.894314 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.896359 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:16.896374 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.897999 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.898009 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:16.898190 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.898223 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:35:16.898320 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 06:35:16.898437 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"mutex_wait_us":25,"thread_start_us":570,"threads_started":1}
I20260809 06:35:16.899273 23181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f46f798dc7441efb0e22320eafb2911" candidate_uuid: "bb573b579f3b416e9d3062303fc4d7f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" is_pre_election: true
I20260809 06:35:16.899858 23181 raft_consensus.cc:2454] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb573b579f3b416e9d3062303fc4d7f7 in term 0.
I20260809 06:35:16.899987 22722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f46f798dc7441efb0e22320eafb2911" candidate_uuid: "bb573b579f3b416e9d3062303fc4d7f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" is_pre_election: true
I20260809 06:35:16.900473 22722 raft_consensus.cc:2454] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb573b579f3b416e9d3062303fc4d7f7 in term 0.
I20260809 06:35:16.900712 22834 leader_election.cc:302] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb573b579f3b416e9d3062303fc4d7f7, e2da1a5e2cc547b5a3831a76a9dec4af; no voters:
I20260809 06:35:16.901134 23308 raft_consensus.cc:2781] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:35:16.901288 23308 raft_consensus.cc:482] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:35:16.901396 23308 raft_consensus.cc:3037] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:35:16.903625 23308 raft_consensus.cc:504] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } }
I20260809 06:35:16.904209 23308 leader_election.cc:288] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [CANDIDATE]: Term 1 election: Requested vote from peers fb1e67cb516c4be8b7df2591fcc5cc50 (127.30.78.65:38663), e2da1a5e2cc547b5a3831a76a9dec4af (127.30.78.67:34131)
I20260809 06:35:16.904600 22722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f46f798dc7441efb0e22320eafb2911" candidate_uuid: "bb573b579f3b416e9d3062303fc4d7f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50"
I20260809 06:35:16.904691 23181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f46f798dc7441efb0e22320eafb2911" candidate_uuid: "bb573b579f3b416e9d3062303fc4d7f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af"
I20260809 06:35:16.904814 22722 raft_consensus.cc:3037] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:35:16.904882 23181 raft_consensus.cc:3037] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:35:16.907917 23181 raft_consensus.cc:2454] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb573b579f3b416e9d3062303fc4d7f7 in term 1.
I20260809 06:35:16.907914 22722 raft_consensus.cc:2454] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb573b579f3b416e9d3062303fc4d7f7 in term 1.
I20260809 06:35:16.908353 22839 leader_election.cc:302] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb573b579f3b416e9d3062303fc4d7f7, fb1e67cb516c4be8b7df2591fcc5cc50; no voters:
I20260809 06:35:16.908651 23308 raft_consensus.cc:2781] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:35:16.909106 23308 raft_consensus.cc:686] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 LEADER]: Becoming Leader. State: Replica: bb573b579f3b416e9d3062303fc4d7f7, State: Running, Role: LEADER
I20260809 06:35:16.909632 23308 consensus_queue.cc:237] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } }
I20260809 06:35:16.913846 22486 catalog_manager.cc:5495] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb573b579f3b416e9d3062303fc4d7f7 (127.30.78.66). New cstate: current_term: 1 leader_uuid: "bb573b579f3b416e9d3062303fc4d7f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } health_report { overall_health: UNKNOWN } } }
I20260809 06:35:17.000392 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:16.995251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59188 (local address 127.30.78.66:41143)
0809 06:35:16.995426 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:16.995431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:16.995448 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:35:16.995531 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:16.995534 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:16.995616 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:16.995732 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:35:16.996084 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.996785 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.998395 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:16.998810 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:16.998904 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:16.999350 (+ 446us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:35:16.999859 (+ 509us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:35:16.999965 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:17.000077 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 06:35:17.000142 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:35:17.008369 22722 raft_consensus.cc:1261] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 1 FOLLOWER]: Refusing update from remote peer bb573b579f3b416e9d3062303fc4d7f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:35:17.008389 23181 raft_consensus.cc:1261] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 FOLLOWER]: Refusing update from remote peer bb573b579f3b416e9d3062303fc4d7f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:35:17.009295 23318 consensus_queue.cc:1035] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:35:17.009636 23308 consensus_queue.cc:1035] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:35:17.020007 23326 mvcc.cc:205] Tried to move back new op lower bound from 7316509970456920064 to 7316509970065743872. Current Snapshot: MvccSnapshot[applied={T|T < 7316509970456920064}]
I20260809 06:35:17.021234 23323 mvcc.cc:205] Tried to move back new op lower bound from 7316509970456920064 to 7316509970065743872. Current Snapshot: MvccSnapshot[applied={T|T < 7316509970456920064}]
I20260809 06:35:17.033975 22483 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:35:17.034214 22483 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55742:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:35:17.037362 22483 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Sending DeleteTablet for 3 replicas of tablet 2f46f798dc7441efb0e22320eafb2911
I20260809 06:35:17.038453 22685 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f46f798dc7441efb0e22320eafb2911 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:35:17 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:40840
I20260809 06:35:17.038580 23140 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f46f798dc7441efb0e22320eafb2911 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:35:17 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:46796
I20260809 06:35:17.038599 22908 tablet_service.cc:1514] Processing DeleteTablet for tablet 2f46f798dc7441efb0e22320eafb2911 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:35:17 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:59186
I20260809 06:35:17.039855 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 22586
I20260809 06:35:17.048622 23341 tablet_replica.cc:330] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: stopping tablet replica
I20260809 06:35:17.049662 23341 raft_consensus.cc:2229] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:35:17.050899 23341 raft_consensus.cc:2258] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:35:17.054646 23338 tablet_replica.cc:330] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: stopping tablet replica
I20260809 06:35:17.054679 23341 ts_tablet_manager.cc:1905] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:35:17.055642 23338 raft_consensus.cc:2229] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:35:17.056579 23338 raft_consensus.cc:2258] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:35:17.057144 23340 tablet_replica.cc:330] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: stopping tablet replica
I20260809 06:35:17.057753 23340 raft_consensus.cc:2229] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:35:17.058286 23340 raft_consensus.cc:2258] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:35:17.059051 23338 ts_tablet_manager.cc:1905] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:35:17.061941 23341 ts_tablet_manager.cc:1918] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:35:17.062153 23341 log.cc:1196] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/2f46f798dc7441efb0e22320eafb2911
I20260809 06:35:17.062731 23341 ts_tablet_manager.cc:1939] T 2f46f798dc7441efb0e22320eafb2911 P bb573b579f3b416e9d3062303fc4d7f7: Deleting consensus metadata
I20260809 06:35:17.064116 23340 ts_tablet_manager.cc:1905] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:35:17.064437 22460 catalog_manager.cc:4841] TS bb573b579f3b416e9d3062303fc4d7f7 (127.30.78.66:41143): tablet 2f46f798dc7441efb0e22320eafb2911 (table test-table [id=0f28e0f6b785446b81295bb671805360]) successfully deleted
I20260809 06:35:17.065665 23338 ts_tablet_manager.cc:1918] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:35:17.065903 23338 log.cc:1196] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/2f46f798dc7441efb0e22320eafb2911
I20260809 06:35:17.066452 23338 ts_tablet_manager.cc:1939] T 2f46f798dc7441efb0e22320eafb2911 P fb1e67cb516c4be8b7df2591fcc5cc50: Deleting consensus metadata
I20260809 06:35:17.068172 22462 catalog_manager.cc:4841] TS fb1e67cb516c4be8b7df2591fcc5cc50 (127.30.78.65:38663): tablet 2f46f798dc7441efb0e22320eafb2911 (table test-table [id=0f28e0f6b785446b81295bb671805360]) successfully deleted
Aug 09 06:35:17 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:35:17.071981 23340 ts_tablet_manager.cc:1918] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:35:17.072260 23340 log.cc:1196] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/2f46f798dc7441efb0e22320eafb2911
I20260809 06:35:17.072880 23340 ts_tablet_manager.cc:1939] T 2f46f798dc7441efb0e22320eafb2911 P e2da1a5e2cc547b5a3831a76a9dec4af: Deleting consensus metadata
I20260809 06:35:17.074747 22458 catalog_manager.cc:4841] TS e2da1a5e2cc547b5a3831a76a9dec4af (127.30.78.67:34131): tablet 2f46f798dc7441efb0e22320eafb2911 (table test-table [id=0f28e0f6b785446b81295bb671805360]) successfully deleted
I20260809 06:35:17.076411 23289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:17.041065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40854 (local address 127.30.78.65:38663)
0809 06:35:17.041238 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:17.041245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:17.053869 (+ 12624us) server_negotiation.cc:407] Connection header received
0809 06:35:17.054347 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:17.054353 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:17.054452 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:17.054538 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:17.058522 (+ 3984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:17.059738 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:17.064528 (+ 4790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:17.065195 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:17.065293 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:17.070465 (+ 5172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:17.070476 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:17.070491 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:17.070523 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:17.073329 (+ 2806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:17.074105 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:17.074112 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:17.074114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:17.074248 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:17.074676 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:17.074682 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:17.074686 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:17.075188 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:17.075507 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:17.075753 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 06:35:17.075988 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:35:17.077082 22783 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:17.193015 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 22586
I20260809 06:35:17.215875 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 22805
Aug 09 06:35:17 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:35:17.233997 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:17.216676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.30.78.66:41143)
0809 06:35:17.216845 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:17.216850 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:17.216925 (+ 75us) server_negotiation.cc:407] Connection header received
0809 06:35:17.217130 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:17.217134 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:17.217200 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:17.217296 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:17.219146 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:17.220098 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:17.222174 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:17.222596 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:17.222690 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:17.228125 (+ 5435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:17.228139 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:17.228154 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:17.228189 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:17.231276 (+ 3087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:17.231931 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:17.231937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:17.231940 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:17.232077 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:17.232443 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:17.232446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:17.232448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:17.232802 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:17.233124 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:17.233417 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 06:35:17.233633 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:35:17.234725 23012 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:17.345255 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 22805
I20260809 06:35:17.364460 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 23029
Aug 09 06:35:17 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:35:17.379071 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:17.365181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46802 (local address 127.30.78.67:34131)
0809 06:35:17.365348 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:17.365352 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:17.365375 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:35:17.365522 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:17.365527 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:17.365596 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:17.365683 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:17.367093 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:17.367877 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:17.369245 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:17.369657 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:17.369918 (+ 261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:17.374171 (+ 4253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:17.374187 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:17.374203 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:17.374244 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:17.376715 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:17.377315 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:17.377322 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:17.377324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:17.377463 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:17.377776 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:17.377779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:17.377781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:17.378132 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:17.378344 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:17.378591 (+ 247us) server_negotiation.cc:299] Negotiation successful
0809 06:35:17.378749 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:35:17.379654 23260 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:17.466171 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 23029
I20260809 06:35:17.486006 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 22433
I20260809 06:35:17.487099 22530 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:17.593987 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 22433
I20260809 06:35:37.620754 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33845
--webserver_interface=127.30.78.126
--webserver_port=43761
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:33845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:35:37.944795 23353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:35:37.945048 23353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:35:37.945140 23353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:35:37.951900 23353 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 06:35:37.951982 23353 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 06:35:37.952024 23353 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 06:35:37.952073 23353 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:35:37.952124 23353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:35:37.952188 23353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:35:37.952231 23353 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:35:37.952283 23353 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:35:37.961469 23353 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:33845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=43761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:35:37.962594 23353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:35:37.963795 23353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:35:37.985503 23365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:37.985579 23369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:37.985670 23364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:35:37.986496 23353 server_base.cc:1034] running on GCE node
I20260809 06:35:37.987278 23353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:35:37.988705 23353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:35:37.989920 23353 hybrid_clock.cc:648] HybridClock initialized: now 1786257337989844 us; error 37 us; skew 500 ppm
I20260809 06:35:37.990294 23353 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:35:37 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257337, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:35:37.998842 23353 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:35:38.000530 23353 webserver.cc:460] Webserver started at http://127.30.78.126:43761/ using document root <none> and password file <none>
I20260809 06:35:38.001277 23353 fs_manager.cc:359] Metadata directory not provided
I20260809 06:35:38.001411 23353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:35:38.007197 23353 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:35:38.009958 23380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:38.011222 23353 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:35:38.011369 23353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "54e4e9f49fd047f98fb75ca88fa14d55"
format_stamp: "Formatted at 2026-08-09 06:35:14 on dist-test-slave-cvwc"
server_key: "4b04c6f7c16af1530f09756c7d5314a3"
server_key_iv: "6711004b06385af112c6f9ab2cfd343b"
server_key_version: "encryptionkey@0"
I20260809 06:35:38.012388 23353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:35:38.029500 23353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:35:38.033092 23353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:35:38.033344 23353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:35:38.050663 23353 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:33845
I20260809 06:35:38.050697 23476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:33845 every 8 connection(s)
I20260809 06:35:38.052083 23353 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:35:38.055806 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 23353
I20260809 06:35:38.056576 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:38663
--local_ip_for_outbound_sockets=127.30.78.65
--tserver_master_addrs=127.30.78.126:33845
--webserver_port=38385
--webserver_interface=127.30.78.65
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:35:38.058877 23477 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:35:38.062016 23477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Bootstrap starting.
I20260809 06:35:38.080775 23477 log.cc:824] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Log is configured to *not* fsync() on all Append() calls
I20260809 06:35:38.092430 23477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:35:38.092908 23477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Bootstrap complete.
I20260809 06:35:38.101675 23477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:35:38.102528 23477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e4e9f49fd047f98fb75ca88fa14d55, State: Initialized, Role: FOLLOWER
I20260809 06:35:38.103082 23477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:35:38.103314 23477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:35:38.103420 23477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:35:38.103569 23477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 1 FOLLOWER]: Advancing to term 2
I20260809 06:35:38.107172 23477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:35:38.107640 23477 leader_election.cc:302] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54e4e9f49fd047f98fb75ca88fa14d55; no voters:
I20260809 06:35:38.108240 23477 leader_election.cc:288] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260809 06:35:38.108378 23482 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 2 FOLLOWER]: Leader election won for term 2
I20260809 06:35:38.109543 23482 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 2 LEADER]: Becoming Leader. State: Replica: 54e4e9f49fd047f98fb75ca88fa14d55, State: Running, Role: LEADER
I20260809 06:35:38.110168 23482 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:35:38.110433 23477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:35:38.114364 23483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } } }
I20260809 06:35:38.114773 23483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: This master's current role is: LEADER
I20260809 06:35:38.115393 23484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54e4e9f49fd047f98fb75ca88fa14d55. Latest consensus state: current_term: 2 leader_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } } }
I20260809 06:35:38.115737 23484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: This master's current role is: LEADER
I20260809 06:35:38.126828 23490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:35:38.135263 23490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:35:38.136897 23490 catalog_manager.cc:1259] Loaded cluster ID: de5458f61ad64144b28769ae00e14bb5
I20260809 06:35:38.137053 23490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:35:38.141523 23490 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:35:38.143397 23490 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Loaded TSK: 0
I20260809 06:35:38.174222 23490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Generated new TSK 1
I20260809 06:35:38.174625 23490 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 06:35:38.408733 23479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:35:38.409016 23479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:35:38.409170 23479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:35:38.416463 23479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:35:38.416585 23479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:35:38.416755 23479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:35:38.426405 23479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:38663
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=38385
--tserver_master_addrs=127.30.78.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:35:38.427610 23479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:35:38.428911 23479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:35:38.443269 23511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:38.443356 23510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:38.444185 23516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:35:38.444242 23479 server_base.cc:1034] running on GCE node
I20260809 06:35:38.444834 23479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:35:38.445740 23479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:35:38.446949 23479 hybrid_clock.cc:648] HybridClock initialized: now 1786257338446893 us; error 52 us; skew 500 ppm
I20260809 06:35:38.447234 23479 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:35:38 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257338, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:35:38.450169 23479 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:35:38.451562 23479 webserver.cc:460] Webserver started at http://127.30.78.65:38385/ using document root <none> and password file <none>
I20260809 06:35:38.452183 23479 fs_manager.cc:359] Metadata directory not provided
I20260809 06:35:38.452306 23479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:35:38.457410 23479 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:35:38.460101 23526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:38.461402 23479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260809 06:35:38.461557 23479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "fb1e67cb516c4be8b7df2591fcc5cc50"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "b19b14fe35e4390b6748929a6180aa26"
server_key_iv: "5a9e2c285ae0b6dd2ef993c540049654"
server_key_version: "encryptionkey@0"
I20260809 06:35:38.462512 23479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:35:38.479291 23479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:35:38.483136 23479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:35:38.483371 23479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:35:38.484248 23479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:35:38.485467 23479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:35:38.485569 23479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:38.485671 23479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:35:38.485759 23479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:38.515079 23479 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:38663
I20260809 06:35:38.515154 23697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:38663 every 8 connection(s)
I20260809 06:35:38.516505 23479 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:35:38.522727 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 23479
I20260809 06:35:38.523307 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:41143
--local_ip_for_outbound_sockets=127.30.78.66
--tserver_master_addrs=127.30.78.126:33845
--webserver_port=41971
--webserver_interface=127.30.78.66
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:35:38 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257338, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:35:38.538727 23701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:38.519389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:49669)
0809 06:35:38.520217 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:38.520269 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:38.521928 (+ 1659us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:38.523183 (+ 1255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:38.523194 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:38.523810 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:35:38.524313 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:38.524329 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:38.525927 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:38.525931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:38.527569 (+ 1638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:38.527582 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:38.528579 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:38.528587 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:38.528852 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:38.529447 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:35:38.529468 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:35:38.531524 (+ 2056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:35:38.534620 (+ 3096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:38.534628 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:38.534641 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:38.535026 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:38.535436 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:38.535441 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:38.535445 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:38.535613 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:38.536292 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:35:38.536299 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:35:38.536667 (+ 368us) client_negotiation.cc:769] Sending connection context
0809 06:35:38.536958 (+ 291us) client_negotiation.cc:240] Negotiation successful
0809 06:35:38.537438 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":314,"threads_started":1}
I20260809 06:35:38.538717 23700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:38.519127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:49669 (local address 127.30.78.126:33845)
0809 06:35:38.519646 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:38.519657 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:38.520376 (+ 719us) server_negotiation.cc:407] Connection header received
0809 06:35:38.522361 (+ 1985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:38.522373 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:38.522671 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:38.523026 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:38.524513 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:38.525765 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:38.527697 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:38.528354 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:38.528518 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:38.531767 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:38.531774 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:38.531787 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:38.531822 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:38.534488 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:38.535154 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:38.535160 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:38.535166 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:38.535321 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:38.535719 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:38.535723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:38.535725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:38.536157 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:38.536334 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:38.537168 (+ 834us) server_negotiation.cc:299] Negotiation successful
0809 06:35:38.537537 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":238,"threads_started":1}
I20260809 06:35:38.541358 23698 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33845
I20260809 06:35:38.541613 23698 heartbeater.cc:464] Registering TS with master...
I20260809 06:35:38.542284 23698 heartbeater.cc:511] Master 127.30.78.126:33845 requested a full tablet report, sending...
I20260809 06:35:38.544473 23420 ts_manager.cc:194] Registered new tserver with Master: fb1e67cb516c4be8b7df2591fcc5cc50 (127.30.78.65:38663)
I20260809 06:35:38.546018 23420 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:49669
W20260809 06:35:38.841452 23703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:35:38.841707 23703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:35:38.841878 23703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:35:38.850433 23703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:35:38.850545 23703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:35:38.850692 23703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:35:38.862336 23703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:41143
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=41971
--tserver_master_addrs=127.30.78.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:35:38.863719 23703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:35:38.865025 23703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:35:38.876850 23715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:38.876993 23718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:38.876968 23720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:35:38.878311 23703 server_base.cc:1034] running on GCE node
I20260809 06:35:38.878877 23703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:35:38.879678 23703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:35:38.880877 23703 hybrid_clock.cc:648] HybridClock initialized: now 1786257338880827 us; error 41 us; skew 500 ppm
I20260809 06:35:38.881145 23703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:35:38 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257338, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:35:38.884045 23703 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:35:38.885370 23703 webserver.cc:460] Webserver started at http://127.30.78.66:41971/ using document root <none> and password file <none>
I20260809 06:35:38.886061 23703 fs_manager.cc:359] Metadata directory not provided
I20260809 06:35:38.886184 23703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:35:38.890975 23703 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:35:38.893357 23730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:38.894557 23703 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 06:35:38.894701 23703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "bb573b579f3b416e9d3062303fc4d7f7"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "2b7f29ae5aaf56fe6821bfe4c1de81a2"
server_key_iv: "33eb7e9316e3078d07233bb5b5caea2c"
server_key_version: "encryptionkey@0"
I20260809 06:35:38.895598 23703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:35:38.924645 23703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:35:38.928624 23703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:35:38.928870 23703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:35:38.929780 23703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:35:38.930970 23703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:35:38.931064 23703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:38.931164 23703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:35:38.931232 23703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:38.961274 23703 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:41143
I20260809 06:35:38.961333 23919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:41143 every 8 connection(s)
I20260809 06:35:38.962602 23703 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:35:38.965868 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 23703
I20260809 06:35:38.966629 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:34131
--local_ip_for_outbound_sockets=127.30.78.67
--tserver_master_addrs=127.30.78.126:33845
--webserver_port=38863
--webserver_interface=127.30.78.67
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 09 06:35:38 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257338, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:35:38.982548 23700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:38.964885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:44185 (local address 127.30.78.126:33845)
0809 06:35:38.965102 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:38.965109 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:38.966397 (+ 1288us) server_negotiation.cc:407] Connection header received
0809 06:35:38.968299 (+ 1902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:38.968305 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:38.968388 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:38.968484 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:38.970174 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:38.971085 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:38.973076 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:38.973630 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:38.973795 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:38.977022 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:38.977029 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:38.977033 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:38.977073 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:38.979526 (+ 2453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:38.980295 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:38.980298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:38.980300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:38.980407 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:38.980884 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:38.980888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:38.980890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:38.981173 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:38.981291 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:38.982118 (+ 827us) server_negotiation.cc:299] Negotiation successful
0809 06:35:38.982288 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:35:38.983805 23926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:38.965429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:44185)
0809 06:35:38.966247 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:38.966288 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:38.968020 (+ 1732us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:38.968688 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:38.968696 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:38.969181 (+ 485us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:35:38.969996 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:38.970018 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:38.971241 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:38.971246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:38.972912 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:38.972938 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:38.973850 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:38.973855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:38.974097 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:38.974680 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:35:38.974702 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:35:38.976791 (+ 2089us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:35:38.979656 (+ 2865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:38.979663 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:38.979676 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:38.980193 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:38.980512 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:38.980517 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:38.980520 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:38.980739 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:38.981298 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:35:38.981306 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:35:38.981662 (+ 356us) client_negotiation.cc:769] Sending connection context
0809 06:35:38.982038 (+ 376us) client_negotiation.cc:240] Negotiation successful
0809 06:35:38.982509 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":357,"threads_started":1}
I20260809 06:35:38.985242 23920 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33845
I20260809 06:35:38.985546 23920 heartbeater.cc:464] Registering TS with master...
I20260809 06:35:38.986424 23920 heartbeater.cc:511] Master 127.30.78.126:33845 requested a full tablet report, sending...
I20260809 06:35:38.987967 23420 ts_manager.cc:194] Registered new tserver with Master: bb573b579f3b416e9d3062303fc4d7f7 (127.30.78.66:41143)
I20260809 06:35:38.989039 23420 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:44185
W20260809 06:35:39.298102 23927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:35:39.298357 23927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:35:39.298497 23927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:35:39.305522 23927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:35:39.305615 23927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:35:39.305753 23927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:35:39.314807 23927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:34131
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=38863
--tserver_master_addrs=127.30.78.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:35:39.315965 23927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:35:39.317210 23927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:35:39.329321 23939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:39.329392 23935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:35:39.329407 23934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:35:39.330245 23927 server_base.cc:1034] running on GCE node
I20260809 06:35:39.330792 23927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:35:39.331594 23927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:35:39.332779 23927 hybrid_clock.cc:648] HybridClock initialized: now 1786257339332737 us; error 37 us; skew 500 ppm
I20260809 06:35:39.333039 23927 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:35:39 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257339, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:35:39.335901 23927 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:35:39.337152 23927 webserver.cc:460] Webserver started at http://127.30.78.67:38863/ using document root <none> and password file <none>
I20260809 06:35:39.337786 23927 fs_manager.cc:359] Metadata directory not provided
I20260809 06:35:39.337924 23927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:35:39.342798 23927 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260809 06:35:39.345214 23952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:39.346412 23927 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 06:35:39.346562 23927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "e2da1a5e2cc547b5a3831a76a9dec4af"
format_stamp: "Formatted at 2026-08-09 06:35:16 on dist-test-slave-cvwc"
server_key: "9c49f3f04c573d67a72b5536ad85c6c5"
server_key_iv: "1f13443189cf659e27deb7e42214c5c2"
server_key_version: "encryptionkey@0"
I20260809 06:35:39.347466 23927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:35:39.368180 23927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:35:39.371866 23927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:35:39.372118 23927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:35:39.373018 23927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:35:39.374343 23927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:35:39.374439 23927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:39.374555 23927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:35:39.374626 23927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:35:39.404125 23927 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:34131
I20260809 06:35:39.404192 24132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:34131 every 8 connection(s)
I20260809 06:35:39.405450 23927 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:35:39.414145 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 23927
Aug 09 06:35:39 dist-test-slave-cvwc krb5kdc[22412](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257339, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:35:39.425374 23700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.407830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:56201 (local address 127.30.78.126:33845)
0809 06:35:39.408031 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.408037 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.409161 (+ 1124us) server_negotiation.cc:407] Connection header received
0809 06:35:39.411039 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.411043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.411109 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.411189 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:39.412595 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.413313 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.415229 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.415861 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.415973 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.419806 (+ 3833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:39.419811 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:39.419814 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:39.419844 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:39.422495 (+ 2651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:39.423160 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:39.423164 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:39.423166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:39.423284 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:39.423706 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:39.423709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:39.423711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:39.423979 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:39.424111 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.424766 (+ 655us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.425002 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:35:39.426232 24137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.408330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:56201)
0809 06:35:39.409017 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:39.409055 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:39.410782 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:39.411391 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:39.411398 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:39.411933 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:35:39.412451 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.412468 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.413429 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.413433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.415096 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.415109 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.416105 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.416112 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.416338 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.417034 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:35:39.417069 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:35:39.419591 (+ 2522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:35:39.422622 (+ 3031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:39.422631 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:39.422646 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:39.423037 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:39.423395 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:35:39.423399 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:35:39.423402 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:35:39.423591 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:35:39.424102 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:35:39.424109 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:35:39.424412 (+ 303us) client_negotiation.cc:769] Sending connection context
0809 06:35:39.424644 (+ 232us) client_negotiation.cc:240] Negotiation successful
0809 06:35:39.425102 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":265,"threads_started":1}
I20260809 06:35:39.427632 24133 heartbeater.cc:347] Connected to a master server at 127.30.78.126:33845
I20260809 06:35:39.427944 24133 heartbeater.cc:464] Registering TS with master...
I20260809 06:35:39.428654 24133 heartbeater.cc:511] Master 127.30.78.126:33845 requested a full tablet report, sending...
I20260809 06:35:39.430145 23420 ts_manager.cc:194] Registered new tserver with Master: e2da1a5e2cc547b5a3831a76a9dec4af (127.30.78.67:34131)
I20260809 06:35:39.430534 24138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.415066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54630 (local address 127.30.78.126:33845)
0809 06:35:39.415561 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.415566 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.417351 (+ 1785us) server_negotiation.cc:407] Connection header received
0809 06:35:39.417538 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.417542 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.417595 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.417671 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:39.419520 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.420381 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.421932 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.422379 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.422495 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.424906 (+ 2411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:39.424910 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:39.424913 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:39.424940 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:39.428024 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:39.428629 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:39.428634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:39.428638 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:39.428777 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:39.429104 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:39.429108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:39.429111 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:39.429429 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:39.429657 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.429995 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.430205 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":282,"threads_started":1}
I20260809 06:35:39.431100 23420 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:56201
I20260809 06:35:39.432967 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:35:39.438627 24138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.433827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54636 (local address 127.30.78.126:33845)
0809 06:35:39.434005 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.434011 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.434318 (+ 307us) server_negotiation.cc:407] Connection header received
0809 06:35:39.434464 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.434467 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.434575 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.434679 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:35:39.435016 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.435642 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.436980 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.437384 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.437467 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.437904 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:35:39.438157 (+ 253us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0809 06:35:39.438408 (+ 251us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54636: token expired
Metrics: {"server-negotiator.queue_time_us":48}
W20260809 06:35:39.438738 24138 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54636: token expired
W20260809 06:35:39.439249 23277 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.30.78.126:33845)
I20260809 06:35:39.450614 24138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.439769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54642 (local address 127.30.78.126:33845)
0809 06:35:39.439921 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.439926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.439941 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:35:39.439973 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.439976 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.440021 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.440092 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:39.441302 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.442026 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.443315 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.443678 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.443776 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.446158 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:39.446162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:39.446165 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:39.446191 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:39.448259 (+ 2068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:39.448846 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:39.448851 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:39.448854 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:39.448970 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:39.449305 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:39.449310 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:39.449313 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:39.449589 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:39.449826 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.450132 (+ 306us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.450316 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 06:35:39.453424 23420 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:35:39.460215 23420 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:35:39.481561 24159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.471980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54228 (local address 127.30.78.66:41143)
0809 06:35:39.474053 (+ 2073us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.474061 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.474093 (+ 32us) server_negotiation.cc:407] Connection header received
0809 06:35:39.474183 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.474190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.474405 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.474581 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:39.475548 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.477136 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.479451 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.480386 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.480504 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.480738 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.481013 (+ 275us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.481188 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1928,"thread_start_us":1792,"threads_started":1}
I20260809 06:35:39.481914 24155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.471302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41143 (local address 127.0.0.1:54228)
0809 06:35:39.473748 (+ 2446us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:39.473765 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:39.473865 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:39.474887 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:39.474892 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:39.474916 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:39.475329 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.475348 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.477283 (+ 1935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.477288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.479306 (+ 2018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.479317 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.480590 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.480597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.480798 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.480842 (+ 44us) client_negotiation.cc:769] Sending connection context
0809 06:35:39.480962 (+ 120us) client_negotiation.cc:240] Negotiation successful
0809 06:35:39.481249 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2320,"mutex_wait_us":69,"thread_start_us":974,"threads_started":1}
I20260809 06:35:39.481995 24158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.471414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56102 (local address 127.30.78.67:34131)
0809 06:35:39.473485 (+ 2071us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.473493 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.473527 (+ 34us) server_negotiation.cc:407] Connection header received
0809 06:35:39.473623 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.473631 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.473894 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.474893 (+ 999us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:39.475288 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.476483 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.479087 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.480458 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.481225 (+ 767us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.481455 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.481520 (+ 65us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.481667 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1901,"thread_start_us":1760,"threads_started":1}
I20260809 06:35:39.482620 24156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.471143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:34131 (local address 127.0.0.1:56102)
0809 06:35:39.472660 (+ 1517us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:39.472708 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:39.472876 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:39.474086 (+ 1210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:39.474092 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:39.474124 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:39.474565 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.474578 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.476619 (+ 2041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.476624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.478934 (+ 2310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.478951 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.480710 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.480717 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.480932 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.480968 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:35:39.481033 (+ 65us) client_negotiation.cc:240] Negotiation successful
0809 06:35:39.481784 (+ 751us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1284,"mutex_wait_us":597,"thread_start_us":2347,"threads_started":1}
I20260809 06:35:39.485992 24160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.474586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38663 (local address 127.0.0.1:56022)
0809 06:35:39.475560 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:39.475582 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:39.475685 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:39.478393 (+ 2708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:39.478397 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:39.478423 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:39.478878 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.478892 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.480729 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.480733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.483140 (+ 2407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.483156 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.485174 (+ 2018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.485180 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.485348 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.485395 (+ 47us) client_negotiation.cc:769] Sending connection context
0809 06:35:39.485484 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 06:35:39.485609 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":2,"thread_start_us":737,"threads_started":1}
I20260809 06:35:39.485811 24038 tablet_service.cc:1467] Processing CreateTablet for tablet a011cff41b7948ee99e1d068d017aa15 (DEFAULT_TABLE table=test-table [id=f299d666594941868edbf72a4c75d13f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:35:39.485905 23814 tablet_service.cc:1467] Processing CreateTablet for tablet a011cff41b7948ee99e1d068d017aa15 (DEFAULT_TABLE table=test-table [id=f299d666594941868edbf72a4c75d13f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:35:39.486747 24161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.475167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56022 (local address 127.30.78.65:38663)
0809 06:35:39.477630 (+ 2463us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.477636 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.477657 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:35:39.477776 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.477784 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.477978 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.478169 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:39.479056 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.480582 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.483327 (+ 2745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.484717 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.484848 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.485023 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.486281 (+ 1258us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.486457 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2335,"thread_start_us":2231,"threads_started":1}
I20260809 06:35:39.487237 24038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a011cff41b7948ee99e1d068d017aa15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:35:39.487270 23814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a011cff41b7948ee99e1d068d017aa15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:35:39.489650 23603 tablet_service.cc:1467] Processing CreateTablet for tablet a011cff41b7948ee99e1d068d017aa15 (DEFAULT_TABLE table=test-table [id=f299d666594941868edbf72a4c75d13f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:35:39.490684 23603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a011cff41b7948ee99e1d068d017aa15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:35:39.504377 24166 tablet_bootstrap.cc:492] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: Bootstrap starting.
I20260809 06:35:39.505260 24165 tablet_bootstrap.cc:492] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: Bootstrap starting.
I20260809 06:35:39.507835 24162 tablet_bootstrap.cc:492] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: Bootstrap starting.
I20260809 06:35:39.508081 24165 tablet_bootstrap.cc:654] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: Neither blocks nor log segments found. Creating new log.
I20260809 06:35:39.508837 24166 tablet_bootstrap.cc:654] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: Neither blocks nor log segments found. Creating new log.
I20260809 06:35:39.509083 24165 log.cc:824] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: Log is configured to *not* fsync() on all Append() calls
I20260809 06:35:39.510116 24166 log.cc:824] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: Log is configured to *not* fsync() on all Append() calls
I20260809 06:35:39.511057 24162 tablet_bootstrap.cc:654] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: Neither blocks nor log segments found. Creating new log.
I20260809 06:35:39.512310 24162 log.cc:824] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: Log is configured to *not* fsync() on all Append() calls
I20260809 06:35:39.513303 24166 tablet_bootstrap.cc:492] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: No bootstrap required, opened a new log
I20260809 06:35:39.513543 24166 ts_tablet_manager.cc:1397] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 06:35:39.514565 24165 tablet_bootstrap.cc:492] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: No bootstrap required, opened a new log
I20260809 06:35:39.514819 24165 ts_tablet_manager.cc:1397] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.001s
I20260809 06:35:39.515187 24162 tablet_bootstrap.cc:492] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: No bootstrap required, opened a new log
I20260809 06:35:39.515419 24162 ts_tablet_manager.cc:1397] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 06:35:39.523175 24165 raft_consensus.cc:348] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.523619 24165 raft_consensus.cc:374] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:35:39.523742 24165 raft_consensus.cc:729] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2da1a5e2cc547b5a3831a76a9dec4af, State: Initialized, Role: FOLLOWER
I20260809 06:35:39.523666 24166 raft_consensus.cc:348] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.524065 24166 raft_consensus.cc:374] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:35:39.524158 24166 raft_consensus.cc:729] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb573b579f3b416e9d3062303fc4d7f7, State: Initialized, Role: FOLLOWER
I20260809 06:35:39.524365 24165 consensus_queue.cc:260] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.524784 24166 consensus_queue.cc:260] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.528640 24162 raft_consensus.cc:348] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.529124 24162 raft_consensus.cc:374] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:35:39.529264 24162 raft_consensus.cc:729] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb1e67cb516c4be8b7df2591fcc5cc50, State: Initialized, Role: FOLLOWER
I20260809 06:35:39.529654 24166 ts_tablet_manager.cc:1428] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: Time spent starting tablet: real 0.016s user 0.012s sys 0.003s
I20260809 06:35:39.529980 23920 heartbeater.cc:503] Master 127.30.78.126:33845 was elected leader, sending a full tablet report...
I20260809 06:35:39.530369 24162 consensus_queue.cc:260] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.534484 24133 heartbeater.cc:503] Master 127.30.78.126:33845 was elected leader, sending a full tablet report...
I20260809 06:35:39.535212 24165 ts_tablet_manager.cc:1428] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: Time spent starting tablet: real 0.020s user 0.011s sys 0.009s
I20260809 06:35:39.536219 23698 heartbeater.cc:503] Master 127.30.78.126:33845 was elected leader, sending a full tablet report...
I20260809 06:35:39.536749 24162 ts_tablet_manager.cc:1428] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: Time spent starting tablet: real 0.021s user 0.010s sys 0.008s
W20260809 06:35:39.657001 24134 tablet.cc:2369] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:35:39.714423 23923 tablet.cc:2369] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:35:39.768604 23699 tablet.cc:2369] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:35:39.836247 24172 raft_consensus.cc:482] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:35:39.836529 24172 raft_consensus.cc:504] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.838387 24172 leader_election.cc:288] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb573b579f3b416e9d3062303fc4d7f7 (127.30.78.66:41143), fb1e67cb516c4be8b7df2591fcc5cc50 (127.30.78.65:38663)
I20260809 06:35:39.839680 24173 raft_consensus.cc:482] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:35:39.840056 24173 raft_consensus.cc:504] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.841885 24173 leader_election.cc:288] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2da1a5e2cc547b5a3831a76a9dec4af (127.30.78.67:34131), fb1e67cb516c4be8b7df2591fcc5cc50 (127.30.78.65:38663)
I20260809 06:35:39.846534 24137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.838755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41143 (local address 127.30.78.67:47983)
0809 06:35:39.839073 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:39.839091 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:39.839223 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:39.839773 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:39.839778 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:39.839803 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:39.840001 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.840015 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.841315 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.841320 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.843830 (+ 2510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.843845 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.845749 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.845755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.845957 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.845997 (+ 40us) client_negotiation.cc:769] Sending connection context
0809 06:35:39.846094 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 06:35:39.846232 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":463}
I20260809 06:35:39.846841 24161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.839039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:33839 (local address 127.30.78.65:38663)
0809 06:35:39.839230 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.839235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.839692 (+ 457us) server_negotiation.cc:407] Connection header received
0809 06:35:39.839861 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.839867 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.839955 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.840046 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:39.840669 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.841554 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.844087 (+ 2533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.845582 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.845753 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.845830 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.846426 (+ 596us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.846575 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:35:39.847160 24159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.838695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:47983 (local address 127.30.78.66:41143)
0809 06:35:39.838931 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.838938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.839334 (+ 396us) server_negotiation.cc:407] Connection header received
0809 06:35:39.839429 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.839434 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.839510 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.839595 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:39.840160 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.841171 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.844010 (+ 2839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.845213 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.845355 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.845450 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.846796 (+ 1346us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.846927 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:35:39.847765 24175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.838913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38663 (local address 127.30.78.67:33839)
0809 06:35:39.839584 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:39.839604 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:39.839737 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:39.840088 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:39.840092 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:39.840117 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:39.840504 (+ 387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.840518 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.841683 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.841688 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.843885 (+ 2197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.843902 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.846028 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.846035 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.846222 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.846256 (+ 34us) client_negotiation.cc:769] Sending connection context
0809 06:35:39.847208 (+ 952us) client_negotiation.cc:240] Negotiation successful
0809 06:35:39.847343 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"mutex_wait_us":4,"thread_start_us":342,"threads_started":1}
I20260809 06:35:39.847932 23843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a011cff41b7948ee99e1d068d017aa15" candidate_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb573b579f3b416e9d3062303fc4d7f7" is_pre_election: true
I20260809 06:35:39.848361 23843 raft_consensus.cc:2454] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2da1a5e2cc547b5a3831a76a9dec4af in term 0.
I20260809 06:35:39.848753 23640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a011cff41b7948ee99e1d068d017aa15" candidate_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" is_pre_election: true
I20260809 06:35:39.849073 23954 leader_election.cc:302] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb573b579f3b416e9d3062303fc4d7f7, e2da1a5e2cc547b5a3831a76a9dec4af; no voters:
I20260809 06:35:39.849334 23640 raft_consensus.cc:2454] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2da1a5e2cc547b5a3831a76a9dec4af in term 0.
I20260809 06:35:39.849512 24172 raft_consensus.cc:2781] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:35:39.849656 24172 raft_consensus.cc:482] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:35:39.849776 24172 raft_consensus.cc:3037] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:35:39.850296 24158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.842291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:55647 (local address 127.30.78.67:34131)
0809 06:35:39.842464 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.842470 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.843081 (+ 611us) server_negotiation.cc:407] Connection header received
0809 06:35:39.843304 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.843308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.843369 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.843431 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:39.844146 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.845167 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.847756 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.848823 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.848951 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.849012 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.849952 (+ 940us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.850080 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:35:39.851090 24178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.842173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:34131 (local address 127.30.78.66:55647)
0809 06:35:39.842985 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:39.843009 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:39.843169 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:39.843597 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:39.843601 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:39.843625 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:39.843999 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.844010 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.845336 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.845341 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.847559 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.847573 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.849330 (+ 1757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.849337 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.849496 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.849672 (+ 176us) client_negotiation.cc:769] Sending connection context
0809 06:35:39.850628 (+ 956us) client_negotiation.cc:240] Negotiation successful
0809 06:35:39.850756 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":664,"threads_started":1}
I20260809 06:35:39.852187 24067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a011cff41b7948ee99e1d068d017aa15" candidate_uuid: "bb573b579f3b416e9d3062303fc4d7f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" is_pre_election: true
I20260809 06:35:39.852996 24172 raft_consensus.cc:504] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.853483 24067 raft_consensus.cc:2379] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb573b579f3b416e9d3062303fc4d7f7 in current term 1: Already voted for candidate e2da1a5e2cc547b5a3831a76a9dec4af in this term.
I20260809 06:35:39.854194 23640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a011cff41b7948ee99e1d068d017aa15" candidate_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50"
I20260809 06:35:39.854395 23640 raft_consensus.cc:3037] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:35:39.855598 24172 leader_election.cc:288] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [CANDIDATE]: Term 1 election: Requested vote from peers bb573b579f3b416e9d3062303fc4d7f7 (127.30.78.66:41143), fb1e67cb516c4be8b7df2591fcc5cc50 (127.30.78.65:38663)
I20260809 06:35:39.856062 23843 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a011cff41b7948ee99e1d068d017aa15" candidate_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb573b579f3b416e9d3062303fc4d7f7"
I20260809 06:35:39.856243 23843 raft_consensus.cc:3037] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:35:39.857520 23640 raft_consensus.cc:2454] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2da1a5e2cc547b5a3831a76a9dec4af in term 1.
I20260809 06:35:39.857944 23956 leader_election.cc:302] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e2da1a5e2cc547b5a3831a76a9dec4af, fb1e67cb516c4be8b7df2591fcc5cc50; no voters:
I20260809 06:35:39.858198 24161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.842677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:48015 (local address 127.30.78.65:38663)
0809 06:35:39.847164 (+ 4487us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.847169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.851391 (+ 4222us) server_negotiation.cc:407] Connection header received
0809 06:35:39.851604 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.851609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.851686 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.851746 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:35:39.852280 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.853270 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.855441 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.856790 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.856969 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.857040 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.857754 (+ 714us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.857905 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4356,"thread_start_us":7822,"threads_started":1}
I20260809 06:35:39.858276 24172 raft_consensus.cc:2781] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:35:39.859041 24178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.842428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38663 (local address 127.30.78.66:48015)
0809 06:35:39.851307 (+ 8879us) negotiation.cc:107] Waiting for socket to connect
0809 06:35:39.851325 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:35:39.851473 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:35:39.851960 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:35:39.851964 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:35:39.851989 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:35:39.852138 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.852147 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.853440 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.853445 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.855283 (+ 1838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:35:39.855298 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.857236 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.857246 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:35:39.857474 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.857509 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 06:35:39.858573 (+ 1064us) client_negotiation.cc:240] Negotiation successful
0809 06:35:39.858732 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8792,"threads_started":1}
I20260809 06:35:39.859586 23843 raft_consensus.cc:2454] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2da1a5e2cc547b5a3831a76a9dec4af in term 1.
I20260809 06:35:39.860015 24172 raft_consensus.cc:686] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 LEADER]: Becoming Leader. State: Replica: e2da1a5e2cc547b5a3831a76a9dec4af, State: Running, Role: LEADER
I20260809 06:35:39.860828 23640 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a011cff41b7948ee99e1d068d017aa15" candidate_uuid: "bb573b579f3b416e9d3062303fc4d7f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" is_pre_election: true
I20260809 06:35:39.860723 24172 consensus_queue.cc:237] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } }
I20260809 06:35:39.861096 23640 raft_consensus.cc:2379] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb573b579f3b416e9d3062303fc4d7f7 in current term 1: Already voted for candidate e2da1a5e2cc547b5a3831a76a9dec4af in this term.
I20260809 06:35:39.861676 23735 leader_election.cc:302] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb573b579f3b416e9d3062303fc4d7f7; no voters: e2da1a5e2cc547b5a3831a76a9dec4af, fb1e67cb516c4be8b7df2591fcc5cc50
I20260809 06:35:39.862051 24173 raft_consensus.cc:2726] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260809 06:35:39.865811 23420 catalog_manager.cc:5495] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af reported cstate change: term changed from 0 to 1, leader changed from <none> to e2da1a5e2cc547b5a3831a76a9dec4af (127.30.78.67). New cstate: current_term: 1 leader_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2da1a5e2cc547b5a3831a76a9dec4af" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 } health_report { overall_health: UNKNOWN } } }
I20260809 06:35:39.932242 24158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.927099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56114 (local address 127.30.78.67:34131)
0809 06:35:39.927264 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.927271 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.927378 (+ 107us) server_negotiation.cc:407] Connection header received
0809 06:35:39.927554 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.927558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.927655 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.927782 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:35:39.928109 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.928827 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.930051 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.930445 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:39.930533 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:39.931180 (+ 647us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:35:39.931673 (+ 493us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:35:39.931778 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:39.931923 (+ 145us) server_negotiation.cc:299] Negotiation successful
0809 06:35:39.931989 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:35:39.939839 23640 raft_consensus.cc:1261] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 1 FOLLOWER]: Refusing update from remote peer e2da1a5e2cc547b5a3831a76a9dec4af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:35:39.939886 23843 raft_consensus.cc:1261] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 FOLLOWER]: Refusing update from remote peer e2da1a5e2cc547b5a3831a76a9dec4af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:35:39.940667 24183 consensus_queue.cc:1035] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb573b579f3b416e9d3062303fc4d7f7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:35:39.940970 24172 consensus_queue.cc:1035] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [LEADER]: Connected to new peer: Peer: permanent_uuid: "fb1e67cb516c4be8b7df2591fcc5cc50" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:35:39.950591 24189 mvcc.cc:205] Tried to move back new op lower bound from 7316510064384413696 to 7316510064073977856. Current Snapshot: MvccSnapshot[applied={T|T < 7316510064384413696}]
I20260809 06:35:39.952386 24194 mvcc.cc:205] Tried to move back new op lower bound from 7316510064384413696 to 7316510064073977856. Current Snapshot: MvccSnapshot[applied={T|T < 7316510064384413696}]
I20260809 06:35:39.955757 24193 mvcc.cc:205] Tried to move back new op lower bound from 7316510064384413696 to 7316510064073977856. Current Snapshot: MvccSnapshot[applied={T|T < 7316510064384413696}]
I20260809 06:35:39.969532 23420 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:35:39.969775 23420 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:35:39.972986 23420 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Sending DeleteTablet for 3 replicas of tablet a011cff41b7948ee99e1d068d017aa15
I20260809 06:35:39.974048 23814 tablet_service.cc:1514] Processing DeleteTablet for tablet a011cff41b7948ee99e1d068d017aa15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:35:39 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:54228
I20260809 06:35:39.974042 24038 tablet_service.cc:1514] Processing DeleteTablet for tablet a011cff41b7948ee99e1d068d017aa15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:35:39 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:56102
I20260809 06:35:39.974681 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 23479
I20260809 06:35:39.974720 23603 tablet_service.cc:1514] Processing DeleteTablet for tablet a011cff41b7948ee99e1d068d017aa15 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:35:39 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:56022
I20260809 06:35:39.988340 24204 tablet_replica.cc:330] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: stopping tablet replica
I20260809 06:35:39.988814 24204 raft_consensus.cc:2229] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:35:39.989370 24204 raft_consensus.cc:2258] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:35:39.990136 24208 tablet_replica.cc:330] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: stopping tablet replica
I20260809 06:35:39.990552 24208 raft_consensus.cc:2229] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:35:39.991034 24208 raft_consensus.cc:2258] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:35:39.995240 24207 tablet_replica.cc:330] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: stopping tablet replica
I20260809 06:35:39.995553 24207 raft_consensus.cc:2229] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:35:39.996068 24207 raft_consensus.cc:2258] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:35:39.997882 24208 ts_tablet_manager.cc:1905] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:35:40.003532 24204 ts_tablet_manager.cc:1905] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:35:40.004427 24208 ts_tablet_manager.cc:1918] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:35:40.004577 24208 log.cc:1196] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/a011cff41b7948ee99e1d068d017aa15
I20260809 06:35:40.004868 24207 ts_tablet_manager.cc:1905] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:35:40.005096 24208 ts_tablet_manager.cc:1939] T a011cff41b7948ee99e1d068d017aa15 P fb1e67cb516c4be8b7df2591fcc5cc50: Deleting consensus metadata
I20260809 06:35:40.006827 23393 catalog_manager.cc:4841] TS fb1e67cb516c4be8b7df2591fcc5cc50 (127.30.78.65:38663): tablet a011cff41b7948ee99e1d068d017aa15 (table test-table [id=f299d666594941868edbf72a4c75d13f]) successfully deleted
I20260809 06:35:40.009477 24204 ts_tablet_manager.cc:1918] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:35:40.009737 24204 log.cc:1196] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/a011cff41b7948ee99e1d068d017aa15
I20260809 06:35:40.010278 24204 ts_tablet_manager.cc:1939] T a011cff41b7948ee99e1d068d017aa15 P bb573b579f3b416e9d3062303fc4d7f7: Deleting consensus metadata
I20260809 06:35:40.012068 23391 catalog_manager.cc:4841] TS bb573b579f3b416e9d3062303fc4d7f7 (127.30.78.66:41143): tablet a011cff41b7948ee99e1d068d017aa15 (table test-table [id=f299d666594941868edbf72a4c75d13f]) successfully deleted
I20260809 06:35:40.015683 24161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:39.975951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56038 (local address 127.30.78.65:38663)
0809 06:35:39.976138 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:39.976145 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:39.985108 (+ 8963us) server_negotiation.cc:407] Connection header received
0809 06:35:39.985534 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:39.985540 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:39.985639 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:39.985739 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:39.991417 (+ 5678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:39.992622 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:40.003168 (+ 10546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:40.003769 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:40.003908 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:40.009315 (+ 5407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:40.009329 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:40.009346 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:40.009386 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:40.012766 (+ 3380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:40.013534 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:40.013540 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:40.013543 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:40.013668 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:40.014133 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:40.014136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:40.014139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:40.014471 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:40.014745 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:40.015058 (+ 313us) server_negotiation.cc:299] Negotiation successful
0809 06:35:40.015257 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:35:40.016331 23692 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:40.017166 24207 ts_tablet_manager.cc:1918] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:35:40.017336 24207 log.cc:1196] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/a011cff41b7948ee99e1d068d017aa15
I20260809 06:35:40.017963 24207 ts_tablet_manager.cc:1939] T a011cff41b7948ee99e1d068d017aa15 P e2da1a5e2cc547b5a3831a76a9dec4af: Deleting consensus metadata
I20260809 06:35:40.019708 23388 catalog_manager.cc:4841] TS e2da1a5e2cc547b5a3831a76a9dec4af (127.30.78.67:34131): tablet a011cff41b7948ee99e1d068d017aa15 (table test-table [id=f299d666594941868edbf72a4c75d13f]) successfully deleted
I20260809 06:35:40.104343 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 23479
I20260809 06:35:40.126962 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 23703
I20260809 06:35:40.142019 24159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:40.127755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54232 (local address 127.30.78.66:41143)
0809 06:35:40.127931 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:40.127935 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:40.128041 (+ 106us) server_negotiation.cc:407] Connection header received
0809 06:35:40.128238 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:40.128243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:40.128315 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:40.128400 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:40.130093 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:40.130780 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:40.132658 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:40.133073 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:40.133160 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:40.136456 (+ 3296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:40.136470 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:40.136486 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:40.136518 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:40.139194 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:40.140017 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:40.140024 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:40.140026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:40.140152 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:40.140520 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:40.140523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:40.140525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:40.140844 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:40.141059 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:40.141375 (+ 316us) server_negotiation.cc:299] Negotiation successful
0809 06:35:40.141527 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:35:40.142616 23911 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:40.232101 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 23703
I20260809 06:35:40.253428 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 23927
I20260809 06:35:40.269731 24158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:35:40.254308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56118 (local address 127.30.78.67:34131)
0809 06:35:40.254521 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0809 06:35:40.254526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:35:40.254617 (+ 91us) server_negotiation.cc:407] Connection header received
0809 06:35:40.254799 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:35:40.254802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:35:40.254882 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:35:40.254972 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:35:40.256949 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:40.257681 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:40.259639 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:35:40.260082 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:35:40.260179 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:35:40.263717 (+ 3538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:35:40.263729 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:35:40.263750 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:35:40.263791 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:35:40.266869 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:40.267739 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:40.267745 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:40.267748 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:40.267888 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:35:40.268286 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:35:40.268288 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:35:40.268290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:35:40.268680 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:35:40.268933 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0809 06:35:40.269244 (+ 311us) server_negotiation.cc:299] Negotiation successful
0809 06:35:40.269423 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260809 06:35:40.270407 24125 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:40.410331 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 23927
I20260809 06:35:40.436365 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 23353
I20260809 06:35:40.437453 23471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:35:40.550855 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 23353
I20260809 06:36:00.576857 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33845
--webserver_interface=127.30.78.126
--webserver_port=43761
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:33845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:00.906333 24219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:00.906605 24219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:00.906734 24219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:00.913662 24219 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260809 06:36:00.913785 24219 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260809 06:36:00.913851 24219 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260809 06:36:00.913924 24219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:00.913996 24219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:00.914088 24219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:00.914143 24219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:00.914216 24219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:00.923810 24219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:33845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=43761
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:00.925251 24219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:00.926959 24219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:00.938189 24227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:00.938254 24225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:00.938227 24233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:00.939597 24219 server_base.cc:1034] running on GCE node
I20260809 06:36:00.940359 24219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:00.941634 24219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:00.942849 24219 hybrid_clock.cc:648] HybridClock initialized: now 1786257360942780 us; error 39 us; skew 500 ppm
I20260809 06:36:00.943147 24219 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:00 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257360, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:00.946112 24219 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:36:00.947487 24219 webserver.cc:460] Webserver started at http://127.30.78.126:43761/ using document root <none> and password file <none>
I20260809 06:36:00.948137 24219 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:00.948241 24219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:00.953346 24219 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:36:00.955973 24242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:00.957161 24219 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:36:00.957322 24219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "54e4e9f49fd047f98fb75ca88fa14d55"
format_stamp: "Formatted at 2026-08-09 06:35:14 on dist-test-slave-cvwc"
server_key: "4b04c6f7c16af1530f09756c7d5314a3"
server_key_iv: "6711004b06385af112c6f9ab2cfd343b"
server_key_version: "encryptionkey@0"
I20260809 06:36:00.958257 24219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:00.973634 24219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:00.977547 24219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:00.977839 24219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:00.994663 24219 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:33845
I20260809 06:36:00.994701 24329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:33845 every 8 connection(s)
I20260809 06:36:00.996024 24219 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:01.001590 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 24219
I20260809 06:36:01.002616 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:38663
--local_ip_for_outbound_sockets=127.30.78.65
--tserver_master_addrs=127.30.78.126:33845
--webserver_port=38385
--webserver_interface=127.30.78.65
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:36:01.003160 24330 sys_catalog.cc:263] Verifying existing consensus state
I20260809 06:36:01.007294 24330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Bootstrap starting.
I20260809 06:36:01.027894 24330 log.cc:824] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:01.043282 24330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260809 06:36:01.043757 24330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Bootstrap complete.
I20260809 06:36:01.052362 24330 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:36:01.053220 24330 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54e4e9f49fd047f98fb75ca88fa14d55, State: Initialized, Role: FOLLOWER
I20260809 06:36:01.053807 24330 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:36:01.054028 24330 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:01.054132 24330 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:01.054291 24330 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 2 FOLLOWER]: Advancing to term 3
I20260809 06:36:01.057971 24330 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:36:01.058435 24330 leader_election.cc:302] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54e4e9f49fd047f98fb75ca88fa14d55; no voters:
I20260809 06:36:01.059088 24330 leader_election.cc:288] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260809 06:36:01.059222 24340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 3 FOLLOWER]: Leader election won for term 3
I20260809 06:36:01.060286 24340 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [term 3 LEADER]: Becoming Leader. State: Replica: 54e4e9f49fd047f98fb75ca88fa14d55, State: Running, Role: LEADER
I20260809 06:36:01.060809 24340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } }
I20260809 06:36:01.061200 24330 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:01.063427 24342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54e4e9f49fd047f98fb75ca88fa14d55. Latest consensus state: current_term: 3 leader_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } } }
I20260809 06:36:01.063432 24341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54e4e9f49fd047f98fb75ca88fa14d55" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33845 } } }
I20260809 06:36:01.063802 24342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:01.063807 24341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:01.075623 24348 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:01.084169 24348 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:01.085621 24348 catalog_manager.cc:1259] Loaded cluster ID: de5458f61ad64144b28769ae00e14bb5
I20260809 06:36:01.085800 24348 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:01.089743 24348 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:01.091344 24348 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Loaded TSK: 0
I20260809 06:36:01.091563 24348 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 54e4e9f49fd047f98fb75ca88fa14d55: Loaded TSK: 1
F20260809 06:36:01.092739 24348 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f13f689b9ad google::LogMessage::Fail() at ??:0
@ 0x7f13f689e88a google::LogMessage::SendToLog() at ??:0
@ 0x7f13f689b4de google::LogMessage::Flush() at ??:0
@ 0x7f13f689ca19 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260809 06:36:01.110901 24369 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f13fa5ff7d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f13fa5ee73e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f140c2ca1c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f140c2c9783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f140c3552a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f140c3550c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f140c39f5e9 std::function<>::operator()() at ??:0
@ 0x7f140c2cdcdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f140c2cbc36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f140c353610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f140c353439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f13f94e7345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f13f94ea91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f13f94ea799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f13f94c5eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f13fc79f6db start_thread at ??:0
@ 0x7f13f573561f clone at ??:0
W20260809 06:36:01.382464 24334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:01.382717 24334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:01.382859 24334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:01.389881 24334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:01.389979 24334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:01.390132 24334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:36:01.399408 24334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:38663
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=38385
--tserver_master_addrs=127.30.78.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:01.400589 24334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:01.401895 24334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:01.414160 24409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:01.414155 24413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:01.414191 24410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:01.415216 24334 server_base.cc:1034] running on GCE node
I20260809 06:36:01.415809 24334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:01.416620 24334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:01.417797 24334 hybrid_clock.cc:648] HybridClock initialized: now 1786257361417745 us; error 45 us; skew 500 ppm
I20260809 06:36:01.418105 24334 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:01 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257361, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:01.420960 24334 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:36:01.422289 24334 webserver.cc:460] Webserver started at http://127.30.78.65:38385/ using document root <none> and password file <none>
I20260809 06:36:01.422927 24334 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:01.423045 24334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:01.427958 24334 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260809 06:36:01.430409 24427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:01.431581 24334 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:01.431721 24334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "fb1e67cb516c4be8b7df2591fcc5cc50"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "b19b14fe35e4390b6748929a6180aa26"
server_key_iv: "5a9e2c285ae0b6dd2ef993c540049654"
server_key_version: "encryptionkey@0"
I20260809 06:36:01.432629 24334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:01.462318 24334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:01.465878 24334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:01.466130 24334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:01.467046 24334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:01.468298 24334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:01.468395 24334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:01.468502 24334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:01.468585 24334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:01.498930 24334 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:38663
I20260809 06:36:01.498951 24614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:38663 every 8 connection(s)
I20260809 06:36:01.500478 24334 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:36:01.502790 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 24334
I20260809 06:36:01.503376 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:41143
--local_ip_for_outbound_sockets=127.30.78.66
--tserver_master_addrs=127.30.78.126:33845
--webserver_port=41971
--webserver_interface=127.30.78.66
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:36:01.505579 24618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:01.503330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:37197)
0809 06:36:01.504156 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:01.504452 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":308,"threads_started":1}
W20260809 06:36:01.506304 24616 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:33845 (0 consecutive failures): Network error: Failed to ping master at 127.30.78.126:33845: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
I20260809 06:36:01.507210 24618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:01.506766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:59669)
0809 06:36:01.506924 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:01.507091 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260809 06:36:01.508021 24618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:01.507678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:42627)
0809 06:36:01.507805 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:01.507899 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 06:36:01.508246 24616 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:36:01.823576 24620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:01.823825 24620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:01.823962 24620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:01.830907 24620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:01.831012 24620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:01.831157 24620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:36:01.840610 24620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:41143
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=41971
--tserver_master_addrs=127.30.78.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:01.841843 24620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:01.843124 24620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:01.855379 24629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:01.855436 24634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:01.855461 24632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:01.856139 24620 server_base.cc:1034] running on GCE node
I20260809 06:36:01.856711 24620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:01.857524 24620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:01.858711 24620 hybrid_clock.cc:648] HybridClock initialized: now 1786257361858666 us; error 35 us; skew 500 ppm
I20260809 06:36:01.858994 24620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:01 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257361, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:01.865216 24620 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:36:01.866637 24620 webserver.cc:460] Webserver started at http://127.30.78.66:41971/ using document root <none> and password file <none>
I20260809 06:36:01.867282 24620 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:01.867408 24620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:01.872588 24620 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260809 06:36:01.875128 24647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:01.876329 24620 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:36:01.876502 24620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "bb573b579f3b416e9d3062303fc4d7f7"
format_stamp: "Formatted at 2026-08-09 06:35:15 on dist-test-slave-cvwc"
server_key: "2b7f29ae5aaf56fe6821bfe4c1de81a2"
server_key_iv: "33eb7e9316e3078d07233bb5b5caea2c"
server_key_version: "encryptionkey@0"
I20260809 06:36:01.877496 24620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:01.907125 24620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:01.910750 24620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:01.910991 24620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:01.911904 24620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:01.913157 24620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:01.913257 24620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:01.913358 24620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:01.913442 24620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:01.943638 24620 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:41143
I20260809 06:36:01.943698 24823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:41143 every 8 connection(s)
I20260809 06:36:01.944967 24620 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:36:01.947866 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 24620
I20260809 06:36:01.948493 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:34131
--local_ip_for_outbound_sockets=127.30.78.67
--tserver_master_addrs=127.30.78.126:33845
--webserver_port=38863
--webserver_interface=127.30.78.67
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:36:01.949579 24827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:01.947647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:55133)
0809 06:36:01.948444 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:01.948738 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":314,"threads_started":1}
W20260809 06:36:01.950157 24824 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:33845 (0 consecutive failures): Network error: Failed to ping master at 127.30.78.126:33845: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
I20260809 06:36:01.950919 24827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:01.950641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:60705)
0809 06:36:01.950758 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:01.950820 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260809 06:36:01.951642 24827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:01.951360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:57077)
0809 06:36:01.951473 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:01.951541 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 06:36:01.951858 24824 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260809 06:36:02.265442 24828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:02.265729 24828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:02.265885 24828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:02.272851 24828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:02.272951 24828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:02.273099 24828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:36:02.282552 24828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:34131
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=38863
--tserver_master_addrs=127.30.78.126:33845
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:02.283754 24828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:02.284993 24828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:02.297277 24848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:02.297307 24836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:02.297233 24839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:02.298285 24828 server_base.cc:1034] running on GCE node
I20260809 06:36:02.298898 24828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:02.299732 24828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:02.300944 24828 hybrid_clock.cc:648] HybridClock initialized: now 1786257362300886 us; error 50 us; skew 500 ppm
I20260809 06:36:02.301288 24828 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:02 dist-test-slave-cvwc krb5kdc[22412](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257362, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:02.304232 24828 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:36:02.305557 24828 webserver.cc:460] Webserver started at http://127.30.78.67:38863/ using document root <none> and password file <none>
I20260809 06:36:02.306202 24828 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:02.306313 24828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:02.311256 24828 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:36:02.313679 24860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:02.314877 24828 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:02.315003 24828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "e2da1a5e2cc547b5a3831a76a9dec4af"
format_stamp: "Formatted at 2026-08-09 06:35:16 on dist-test-slave-cvwc"
server_key: "9c49f3f04c573d67a72b5536ad85c6c5"
server_key_iv: "1f13443189cf659e27deb7e42214c5c2"
server_key_version: "encryptionkey@0"
I20260809 06:36:02.315850 24828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:02.331349 24828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:02.335175 24828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:02.335386 24828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:02.336277 24828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:02.337486 24828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:02.337569 24828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:02.337642 24828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:02.337699 24828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:02.367060 24828 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:34131
I20260809 06:36:02.367126 25054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:34131 every 8 connection(s)
I20260809 06:36:02.368389 24828 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:36:02.372648 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 24828
I20260809 06:36:02.373073 25057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:02.371073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:43335)
0809 06:36:02.371751 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:02.371985 (+ 234us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":267,"threads_started":1}
W20260809 06:36:02.373822 25055 heartbeater.cc:644] Failed to heartbeat to 127.30.78.126:33845 (0 consecutive failures): Network error: Failed to ping master at 127.30.78.126:33845: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
I20260809 06:36:02.374586 25057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:02.374276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:38625)
0809 06:36:02.374414 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:02.374487 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 06:36:02.375304 25057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:02.375035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:53201)
0809 06:36:02.375134 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:02.375204 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260809 06:36:02.375499 25055 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260809 06:36:02.509449 25060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:02.508708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:42911)
0809 06:36:02.509133 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:02.509214 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":201,"threads_started":1}
I20260809 06:36:02.953032 25061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:02.952307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:54639)
0809 06:36:02.952722 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:02.952803 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":200,"threads_started":1}
I20260809 06:36:03.376718 25062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:03.375977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:48221)
0809 06:36:03.376398 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:03.376500 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":198,"threads_started":1}
I20260809 06:36:03.511099 25063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:03.510390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:34385)
0809 06:36:03.510854 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:03.510933 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":224,"threads_started":1}
I20260809 06:36:03.954464 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:03.953801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:36135)
0809 06:36:03.954227 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:03.954305 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":210,"threads_started":1}
I20260809 06:36:04.378285 25066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:04.377544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:39285)
0809 06:36:04.378036 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:04.378115 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":273,"threads_started":1}
I20260809 06:36:04.512553 25069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:04.511888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:46721)
0809 06:36:04.512312 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:04.512392 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":225,"threads_started":1}
I20260809 06:36:04.955906 25070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:04.955202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:37089)
0809 06:36:04.955633 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:04.955711 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":225,"threads_started":1}
I20260809 06:36:05.379684 25071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:05.379015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:52571)
0809 06:36:05.379433 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:05.379515 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":223,"threads_started":1}
I20260809 06:36:05.514027 25072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:05.513276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:52287)
0809 06:36:05.513748 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:05.513832 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":221,"threads_started":1}
I20260809 06:36:05.957360 25073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:05.956661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:53977)
0809 06:36:05.957085 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:05.957164 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":209,"threads_started":1}
I20260809 06:36:06.381249 25074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:06.380517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:45651)
0809 06:36:06.380982 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:06.381063 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":237,"threads_started":1}
I20260809 06:36:06.515656 25075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:06.514968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:42205)
0809 06:36:06.515420 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:06.515497 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":241,"threads_started":1}
I20260809 06:36:06.958835 25077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:06.958131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:44083)
0809 06:36:06.958597 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:06.958673 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":246,"threads_started":1}
I20260809 06:36:07.382820 25078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:07.382126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:38917)
0809 06:36:07.382578 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:07.382658 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":235,"threads_started":1}
I20260809 06:36:07.517155 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:07.516466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:42465)
0809 06:36:07.516911 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:07.517001 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":222,"threads_started":1}
I20260809 06:36:07.960213 25082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:07.959572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:38125)
0809 06:36:07.959970 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:07.960057 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":204,"threads_started":1}
I20260809 06:36:08.384286 25086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:08.383605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:43495)
0809 06:36:08.384041 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:08.384130 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":214,"threads_started":1}
I20260809 06:36:08.518812 25087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:08.517951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:49371)
0809 06:36:08.518494 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:08.518585 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":219,"threads_started":1}
I20260809 06:36:08.961869 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:08.961004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:42499)
0809 06:36:08.961537 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:08.961621 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":250,"threads_started":1}
I20260809 06:36:09.385839 25090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:09.385068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:49151)
0809 06:36:09.385534 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:09.385611 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":191,"threads_started":1}
I20260809 06:36:09.520295 25091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:09.519630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:41075)
0809 06:36:09.520068 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:09.520143 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":235,"threads_started":1}
I20260809 06:36:09.963356 25092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:09.962684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:50101)
0809 06:36:09.963115 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:09.963194 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":227,"threads_started":1}
I20260809 06:36:10.387395 25096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:10.386677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:38895)
0809 06:36:10.387125 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:10.387219 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":241,"threads_started":1}
I20260809 06:36:10.521821 25097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:10.521060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:54837)
0809 06:36:10.521508 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:10.521616 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":202,"threads_started":1}
I20260809 06:36:10.964900 25098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:10.964142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:46627)
0809 06:36:10.964616 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:10.964721 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":230,"threads_started":1}
I20260809 06:36:11.388837 25099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:11.388166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:51529)
0809 06:36:11.388599 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:11.388674 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":207,"threads_started":1}
I20260809 06:36:11.523263 25100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:11.522615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:47347)
0809 06:36:11.523036 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:11.523113 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":221,"threads_started":1}
I20260809 06:36:11.966463 25106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:11.965773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:46257)
0809 06:36:11.966212 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:11.966291 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":231,"threads_started":1}
I20260809 06:36:12.390414 25112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:12.389701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:37095)
0809 06:36:12.390159 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:12.390241 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":224,"threads_started":1}
I20260809 06:36:12.524736 25115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:12.524033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:55029)
0809 06:36:12.524472 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:12.524561 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":191,"threads_started":1}
I20260809 06:36:12.967975 25116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:12.967284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:58035)
0809 06:36:12.967693 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:12.967784 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":207,"threads_started":1}
I20260809 06:36:13.391882 25117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:13.391174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:37663)
0809 06:36:13.391606 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:13.391693 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":220,"threads_started":1}
I20260809 06:36:13.526177 25119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:13.525493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:46079)
0809 06:36:13.525956 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:13.526032 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":240,"threads_started":1}
I20260809 06:36:13.969444 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:13.968770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:53377)
0809 06:36:13.969203 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:13.969283 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":226,"threads_started":1}
I20260809 06:36:14.393314 25122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:14.392666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:55677)
0809 06:36:14.393083 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:14.393162 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":207,"threads_started":1}
I20260809 06:36:14.527686 25123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:14.526929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:42707)
0809 06:36:14.527417 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:14.527512 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":211,"threads_started":1}
I20260809 06:36:14.970930 25124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:14.970222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:43739)
0809 06:36:14.970653 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:14.970744 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":210,"threads_started":1}
I20260809 06:36:15.394829 25126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:15.394113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:46105)
0809 06:36:15.394557 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:15.394648 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":222,"threads_started":1}
I20260809 06:36:15.529249 25127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:15.528434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:35859)
0809 06:36:15.528832 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:15.528948 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":200,"threads_started":1}
I20260809 06:36:15.972569 25128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:15.971785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:55905)
0809 06:36:15.972289 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:15.972386 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":258,"threads_started":1}
I20260809 06:36:16.396394 25129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:16.395620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:57019)
0809 06:36:16.396113 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:16.396203 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":261,"threads_started":1}
I20260809 06:36:16.530925 25130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:16.530212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.65:33839)
0809 06:36:16.530652 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:16.530736 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":242,"threads_started":1}
I20260809 06:36:16.974341 25131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:16.973599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.66:59287)
0809 06:36:16.974067 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:16.974155 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":254,"threads_started":1}
I20260809 06:36:17.380863 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 24334
I20260809 06:36:17.398154 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:17.397445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33845 (local address 127.30.78.67:57587)
0809 06:36:17.397892 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:17.397979 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.126:33845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":223,"threads_started":1}
I20260809 06:36:17.401638 25132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:17.381945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46368 (local address 127.30.78.65:38663)
0809 06:36:17.382601 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:17.382619 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:17.382672 (+ 53us) server_negotiation.cc:407] Connection header received
0809 06:36:17.384411 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:17.384420 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:17.384848 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:17.385190 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:17.386772 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:17.387984 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:17.389249 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:17.389958 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:17.390141 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:17.395564 (+ 5423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:17.395571 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:17.395586 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:17.395621 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:17.398445 (+ 2824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:17.399156 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:17.399162 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:17.399169 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:17.399338 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:17.399705 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:17.399708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:17.399710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:17.400202 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:17.400521 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:17.400987 (+ 466us) server_negotiation.cc:299] Negotiation successful
0809 06:36:17.401361 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":301,"threads_started":1}
I20260809 06:36:17.402935 24608 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:17.485507 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 24334
I20260809 06:36:17.508700 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 24620
I20260809 06:36:17.525635 25139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:17.509567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41770 (local address 127.30.78.66:41143)
0809 06:36:17.510119 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:17.510132 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:17.510173 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:36:17.511709 (+ 1536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:17.511719 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:17.512147 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:17.512471 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:17.513985 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:17.515234 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:17.516438 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:17.517100 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:17.517272 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:17.519872 (+ 2600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:17.519888 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:17.519902 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:17.519951 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:17.522558 (+ 2607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:17.523208 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:17.523214 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:17.523220 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:17.523385 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:17.523738 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:17.523742 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:17.523744 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:17.524220 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:17.524520 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:17.524983 (+ 463us) server_negotiation.cc:299] Negotiation successful
0809 06:36:17.525356 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":251,"threads_started":1}
I20260809 06:36:17.526924 24817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:17.608605 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 24620
I20260809 06:36:17.629801 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 24828
I20260809 06:36:17.647289 25143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:17.630739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36660 (local address 127.30.78.67:34131)
0809 06:36:17.631310 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:17.631324 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:17.631365 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:36:17.633064 (+ 1699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:17.633074 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:17.633486 (+ 412us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:17.633843 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:17.635346 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:17.636532 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:17.637812 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:17.638471 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:17.638651 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:17.641296 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:17.641304 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:17.641317 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:17.641366 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:17.644150 (+ 2784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:17.644791 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:17.644797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:17.644803 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:17.644971 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:17.645339 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:17.645343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:17.645345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:17.645889 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:17.646168 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:17.646608 (+ 440us) server_negotiation.cc:299] Negotiation successful
0809 06:36:17.646995 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":267,"threads_started":1}
I20260809 06:36:17.648562 25042 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:17.730350 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 24828
2026-08-09T06:36:17Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64704 ms)
[----------] 30 tests from SecurityITest (294064 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:17 dist-test-slave-cvwc krb5kdc[25149](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:17 dist-test-slave-cvwc krb5kdc[25149](info): set up 2 sockets
Aug 09 06:36:17 dist-test-slave-cvwc krb5kdc[25149](info): commencing operation
krb5kdc: starting...
W20260809 06:36:18.938935 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:19 dist-test-slave-cvwc krb5kdc[25149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:36:19.184930 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43661
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:43661
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:19.510258 25171 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:19.510515 25171 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:19.510644 25171 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:19.517599 25171 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:19.517706 25171 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:19.517810 25171 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:19.517886 25171 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:19.517941 25171 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:19.527310 25171 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:43661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:43661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:19.528473 25171 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:19.529739 25171 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:19.540896 25182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:19.540934 25185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:19.540966 25183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:19.541702 25171 server_base.cc:1034] running on GCE node
I20260809 06:36:19.542440 25171 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:19.543748 25171 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:19.544958 25171 hybrid_clock.cc:648] HybridClock initialized: now 1786257379544905 us; error 56 us; skew 500 ppm
I20260809 06:36:19.545276 25171 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:19 dist-test-slave-cvwc krb5kdc[25149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257379, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:19.548265 25171 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:36:19.549656 25171 webserver.cc:460] Webserver started at http://127.30.78.126:39077/ using document root <none> and password file <none>
I20260809 06:36:19.550326 25171 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:19.550446 25171 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:19.550732 25171 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:19.553550 25171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "faa75fcc7ede4b0fa1d945a676a130fc"
format_stamp: "Formatted at 2026-08-09 06:36:19 on dist-test-slave-cvwc"
server_key: "a4022866e93fef4d99c57cd122560a23"
server_key_iv: "a3076cd5b9be996b9fc1ad4cdccc6b0e"
server_key_version: "encryptionkey@0"
I20260809 06:36:19.554308 25171 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "faa75fcc7ede4b0fa1d945a676a130fc"
format_stamp: "Formatted at 2026-08-09 06:36:19 on dist-test-slave-cvwc"
server_key: "a4022866e93fef4d99c57cd122560a23"
server_key_iv: "a3076cd5b9be996b9fc1ad4cdccc6b0e"
server_key_version: "encryptionkey@0"
I20260809 06:36:19.559109 25171 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:36:19.562592 25201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:19.563807 25171 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:36:19.563971 25171 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "faa75fcc7ede4b0fa1d945a676a130fc"
format_stamp: "Formatted at 2026-08-09 06:36:19 on dist-test-slave-cvwc"
server_key: "a4022866e93fef4d99c57cd122560a23"
server_key_iv: "a3076cd5b9be996b9fc1ad4cdccc6b0e"
server_key_version: "encryptionkey@0"
I20260809 06:36:19.564155 25171 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:19.575803 25171 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:19.580103 25171 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:19.580389 25171 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:19.599184 25171 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:43661
I20260809 06:36:19.599191 25280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:43661 every 8 connection(s)
I20260809 06:36:19.600654 25171 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:19.604278 25281 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:19.605997 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 25171
I20260809 06:36:19.606207 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:19.607002 31033 external_mini_cluster.cc:1428] Setting key 8e28024cc315c567b3ef56fb087c2009
I20260809 06:36:19.616286 25281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc: Bootstrap starting.
I20260809 06:36:19.619911 25281 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:19.621119 25281 log.cc:824] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:36:19 dist-test-slave-cvwc krb5kdc[25149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:19.623685 25281 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc: No bootstrap required, opened a new log
I20260809 06:36:19.629128 25285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:19.609047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51016 (local address 127.30.78.126:43661)
0809 06:36:19.609843 (+ 796us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:19.609854 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:19.609899 (+ 45us) server_negotiation.cc:407] Connection header received
0809 06:36:19.611519 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:19.611540 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:19.611881 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:19.612178 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:19.613990 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:19.615290 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:19.617066 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:19.617740 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:19.617882 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:19.622448 (+ 4566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:19.622455 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:19.622469 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:19.622504 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:19.625321 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:19.626004 (+ 683us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:19.626010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:19.626016 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:19.626192 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:19.626561 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:19.626565 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:19.626567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:19.627067 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:19.627361 (+ 294us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:19.627829 (+ 468us) server_negotiation.cc:299] Negotiation successful
0809 06:36:19.628193 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":353,"threads_started":1}
I20260809 06:36:19.631230 25281 raft_consensus.cc:348] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa75fcc7ede4b0fa1d945a676a130fc" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43661 } }
I20260809 06:36:19.631565 25281 raft_consensus.cc:374] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:19.631659 25281 raft_consensus.cc:729] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faa75fcc7ede4b0fa1d945a676a130fc, State: Initialized, Role: FOLLOWER
I20260809 06:36:19.632169 25281 consensus_queue.cc:260] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa75fcc7ede4b0fa1d945a676a130fc" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43661 } }
I20260809 06:36:19.632382 25281 raft_consensus.cc:388] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:19.632503 25281 raft_consensus.cc:482] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:19.632644 25281 raft_consensus.cc:3037] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:19.634907 25281 raft_consensus.cc:504] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa75fcc7ede4b0fa1d945a676a130fc" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43661 } }
I20260809 06:36:19.635339 25281 leader_election.cc:302] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: faa75fcc7ede4b0fa1d945a676a130fc; no voters:
I20260809 06:36:19.635831 25281 leader_election.cc:288] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:19.635941 25288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:19.636608 25288 raft_consensus.cc:686] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [term 1 LEADER]: Becoming Leader. State: Replica: faa75fcc7ede4b0fa1d945a676a130fc, State: Running, Role: LEADER
I20260809 06:36:19.637125 25288 consensus_queue.cc:237] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa75fcc7ede4b0fa1d945a676a130fc" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43661 } }
I20260809 06:36:19.637782 25281 sys_catalog.cc:564] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:19.639892 25290 sys_catalog.cc:455] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader faa75fcc7ede4b0fa1d945a676a130fc. Latest consensus state: current_term: 1 leader_uuid: "faa75fcc7ede4b0fa1d945a676a130fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa75fcc7ede4b0fa1d945a676a130fc" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43661 } } }
I20260809 06:36:19.640303 25290 sys_catalog.cc:458] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:19.642171 25300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:19.642107 25289 sys_catalog.cc:455] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "faa75fcc7ede4b0fa1d945a676a130fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa75fcc7ede4b0fa1d945a676a130fc" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 43661 } } }
I20260809 06:36:19.642426 25289 sys_catalog.cc:458] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:19.646761 25300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:19.655063 25300 catalog_manager.cc:1347] Generated new cluster ID: 6c61fb51c487410c8ada5b23ca66daf4
I20260809 06:36:19.655170 25300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:19.678114 25300 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:19.679867 25300 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:19.689345 25300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc: Generated new TSK 0
I20260809 06:36:19.690312 25300 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:36:19.748692 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43661
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:20.070912 25323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:20.071161 25323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:20.071259 25323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:20.078140 25323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:20.078235 25323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:20.078351 25323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:36:20.087483 25323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43661
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:20.088583 25323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:20.089771 25323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:20.101861 25335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:20.101815 25334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:20.101907 25338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:20.102525 25323 server_base.cc:1034] running on GCE node
I20260809 06:36:20.103024 25323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:20.103806 25323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:20.105000 25323 hybrid_clock.cc:648] HybridClock initialized: now 1786257380104944 us; error 48 us; skew 500 ppm
I20260809 06:36:20.105279 25323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:20 dist-test-slave-cvwc krb5kdc[25149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257380, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:20.108189 25323 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:36:20.109690 25323 webserver.cc:460] Webserver started at http://127.30.78.65:45605/ using document root <none> and password file <none>
I20260809 06:36:20.110353 25323 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:20.110479 25323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:20.110780 25323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:20.113539 25323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "84bb22387fec4eb89841cce115ad4064"
format_stamp: "Formatted at 2026-08-09 06:36:20 on dist-test-slave-cvwc"
server_key: "8af998677827f90218dde312163d6213"
server_key_iv: "eb4298d6f5c7fcad728564378a82756a"
server_key_version: "encryptionkey@0"
I20260809 06:36:20.114308 25323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "84bb22387fec4eb89841cce115ad4064"
format_stamp: "Formatted at 2026-08-09 06:36:20 on dist-test-slave-cvwc"
server_key: "8af998677827f90218dde312163d6213"
server_key_iv: "eb4298d6f5c7fcad728564378a82756a"
server_key_version: "encryptionkey@0"
I20260809 06:36:20.119064 25323 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260809 06:36:20.122255 25346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:20.123510 25323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:36:20.123656 25323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "84bb22387fec4eb89841cce115ad4064"
format_stamp: "Formatted at 2026-08-09 06:36:20 on dist-test-slave-cvwc"
server_key: "8af998677827f90218dde312163d6213"
server_key_iv: "eb4298d6f5c7fcad728564378a82756a"
server_key_version: "encryptionkey@0"
I20260809 06:36:20.123823 25323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:20.150988 25323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:20.154534 25323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:20.154775 25323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:20.155632 25323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:20.156818 25323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:20.156894 25323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:20.157006 25323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:20.157059 25323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:20.186379 25323 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:38939
I20260809 06:36:20.186436 25527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:38939 every 8 connection(s)
I20260809 06:36:20.187548 25323 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:36:20.192579 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 25323
I20260809 06:36:20.192790 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:36:20.193650 31033 external_mini_cluster.cc:1428] Setting key a0d3b24d520dd32832f7c9383c174839
Aug 09 06:36:20 dist-test-slave-cvwc krb5kdc[25149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257380, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:20.206816 25533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:20.189900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:56127 (local address 127.30.78.126:43661)
0809 06:36:20.190329 (+ 429us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:20.190335 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:20.191241 (+ 906us) server_negotiation.cc:407] Connection header received
0809 06:36:20.193306 (+ 2065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:20.193310 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:20.193390 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:20.193482 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:20.195239 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:20.196021 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:20.197492 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:20.197929 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:20.198037 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:20.201474 (+ 3437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:20.201479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:20.201482 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:20.201512 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:20.203946 (+ 2434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:20.204684 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:20.204687 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:20.204689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:20.204793 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:20.205203 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:20.205206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:20.205208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:20.205450 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:20.205558 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:20.206307 (+ 749us) server_negotiation.cc:299] Negotiation successful
0809 06:36:20.206475 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":204,"threads_started":1}
I20260809 06:36:20.207729 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:20.190448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43661 (local address 127.30.78.65:56127)
0809 06:36:20.191089 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:20.191125 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:20.193028 (+ 1903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:20.193759 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:20.193772 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:20.194431 (+ 659us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:20.195066 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:20.195090 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:20.196177 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:20.196181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:20.197343 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:20.197361 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:20.198137 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:20.198145 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:20.198350 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:20.198950 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:36:20.198972 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:20.201273 (+ 2301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:20.204074 (+ 2801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:20.204081 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:20.204094 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:20.204595 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:20.204890 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:20.204895 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:20.204898 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:20.205118 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:20.205560 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:20.205567 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:20.205961 (+ 394us) client_negotiation.cc:769] Sending connection context
0809 06:36:20.206244 (+ 283us) client_negotiation.cc:240] Negotiation successful
0809 06:36:20.206695 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":255,"threads_started":1}
I20260809 06:36:20.209120 25530 heartbeater.cc:347] Connected to a master server at 127.30.78.126:43661
I20260809 06:36:20.209430 25530 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:20.210310 25530 heartbeater.cc:511] Master 127.30.78.126:43661 requested a full tablet report, sending...
I20260809 06:36:20.212363 25224 ts_manager.cc:194] Registered new tserver with Master: 84bb22387fec4eb89841cce115ad4064 (127.30.78.65:38939)
I20260809 06:36:20.213788 25224 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:56127
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:36:20.252547 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43661
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:20.578431 25539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:20.578704 25539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:20.578850 25539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:20.586066 25539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:20.586163 25539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:20.586309 25539 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:36:20.595638 25539 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43661
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:20.596817 25539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:20.598088 25539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:20.610385 25548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:20.610747 25546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:20.610759 25551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:20.612030 25539 server_base.cc:1034] running on GCE node
I20260809 06:36:20.612756 25539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:20.613878 25539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:20.615168 25539 hybrid_clock.cc:648] HybridClock initialized: now 1786257380615080 us; error 70 us; skew 500 ppm
I20260809 06:36:20.615585 25539 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:20 dist-test-slave-cvwc krb5kdc[25149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257380, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:20.620889 25539 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:36:20.622323 25539 webserver.cc:460] Webserver started at http://127.30.78.66:45935/ using document root <none> and password file <none>
I20260809 06:36:20.622970 25539 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:20.623081 25539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:20.623376 25539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:20.626230 25539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "82141a839b204ba495fe62a2c54d7872"
format_stamp: "Formatted at 2026-08-09 06:36:20 on dist-test-slave-cvwc"
server_key: "44033f5650d76b58171bf5d756dfdd20"
server_key_iv: "fdb26c07970d4b51bfaaf0ece129a9c3"
server_key_version: "encryptionkey@0"
I20260809 06:36:20.626998 25539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "82141a839b204ba495fe62a2c54d7872"
format_stamp: "Formatted at 2026-08-09 06:36:20 on dist-test-slave-cvwc"
server_key: "44033f5650d76b58171bf5d756dfdd20"
server_key_iv: "fdb26c07970d4b51bfaaf0ece129a9c3"
server_key_version: "encryptionkey@0"
I20260809 06:36:20.631834 25539 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 06:36:20.635046 25564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:20.636196 25539 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260809 06:36:20.636329 25539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "82141a839b204ba495fe62a2c54d7872"
format_stamp: "Formatted at 2026-08-09 06:36:20 on dist-test-slave-cvwc"
server_key: "44033f5650d76b58171bf5d756dfdd20"
server_key_iv: "fdb26c07970d4b51bfaaf0ece129a9c3"
server_key_version: "encryptionkey@0"
I20260809 06:36:20.636499 25539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:20.649829 25539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:20.653530 25539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:20.653851 25539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:20.654769 25539 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:20.656075 25539 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:20.656157 25539 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:20.656286 25539 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:20.656350 25539 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:20.687712 25539 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:44129
I20260809 06:36:20.687754 25756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:44129 every 8 connection(s)
I20260809 06:36:20.688956 25539 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:36:20.696012 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 25539
I20260809 06:36:20.696197 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:36:20.696744 31033 external_mini_cluster.cc:1428] Setting key 6e29157c7afd41723d31dffd7cf5f70a
Aug 09 06:36:20 dist-test-slave-cvwc krb5kdc[25149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257380, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:20.708694 25533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:20.691483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:47051 (local address 127.30.78.126:43661)
0809 06:36:20.691653 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:20.691658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:20.692758 (+ 1100us) server_negotiation.cc:407] Connection header received
0809 06:36:20.694576 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:20.694581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:20.694652 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:20.694728 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:20.696132 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:20.697170 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:20.699238 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:20.699834 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:20.699959 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:20.703321 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:20.703327 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:20.703331 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:20.703362 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:20.705809 (+ 2447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:20.706562 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:20.706565 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:20.706568 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:20.706690 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:20.707116 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:20.707118 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:20.707120 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:20.707355 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:20.707462 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:20.708195 (+ 733us) server_negotiation.cc:299] Negotiation successful
0809 06:36:20.708420 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:36:20.709864 25763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:20.691889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43661 (local address 127.30.78.66:47051)
0809 06:36:20.692599 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:20.692636 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:20.694304 (+ 1668us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:20.694911 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:20.694919 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:20.695418 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:20.695961 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:20.695977 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:20.697304 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:20.697310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:20.699098 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:20.699110 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:20.700020 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:20.700025 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:20.700219 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:20.700821 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:36:20.700842 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:20.703108 (+ 2266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:20.705939 (+ 2831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:20.705947 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:20.705961 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:20.706463 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:20.706780 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:20.706785 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:20.706788 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:20.707025 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:20.707466 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:20.707473 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:20.707830 (+ 357us) client_negotiation.cc:769] Sending connection context
0809 06:36:20.708112 (+ 282us) client_negotiation.cc:240] Negotiation successful
0809 06:36:20.708590 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":282,"threads_started":1}
I20260809 06:36:20.711251 25757 heartbeater.cc:347] Connected to a master server at 127.30.78.126:43661
I20260809 06:36:20.711572 25757 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:20.712380 25757 heartbeater.cc:511] Master 127.30.78.126:43661 requested a full tablet report, sending...
I20260809 06:36:20.713876 25224 ts_manager.cc:194] Registered new tserver with Master: 82141a839b204ba495fe62a2c54d7872 (127.30.78.66:44129)
I20260809 06:36:20.714648 25224 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:47051
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:36:20.756131 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43661
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:46683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:21.083655 25767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:21.083948 25767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:21.084087 25767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:21.091310 25767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:21.091424 25767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:21.091578 25767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:36:21.100773 25767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:46683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:43661
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:21.101969 25767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:21.103235 25767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:21.115446 25776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:21.115531 25774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:21.115545 25784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:21.116380 25767 server_base.cc:1034] running on GCE node
I20260809 06:36:21.116909 25767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:21.117784 25767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:21.119035 25767 hybrid_clock.cc:648] HybridClock initialized: now 1786257381118974 us; error 51 us; skew 500 ppm
I20260809 06:36:21.119292 25767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:21 dist-test-slave-cvwc krb5kdc[25149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257381, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:21.122148 25767 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:36:21.123461 25767 webserver.cc:460] Webserver started at http://127.30.78.67:40451/ using document root <none> and password file <none>
I20260809 06:36:21.124049 25767 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:21.124162 25767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:21.124457 25767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:21.127267 25767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "ce3010ce50c3428caf19a8aabc4f419a"
format_stamp: "Formatted at 2026-08-09 06:36:21 on dist-test-slave-cvwc"
server_key: "6c4772f4dd91e4348f291325bb092791"
server_key_iv: "189c7b5cd6e62c4e8eeebe7f35cdb629"
server_key_version: "encryptionkey@0"
I20260809 06:36:21.128021 25767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "ce3010ce50c3428caf19a8aabc4f419a"
format_stamp: "Formatted at 2026-08-09 06:36:21 on dist-test-slave-cvwc"
server_key: "6c4772f4dd91e4348f291325bb092791"
server_key_iv: "189c7b5cd6e62c4e8eeebe7f35cdb629"
server_key_version: "encryptionkey@0"
I20260809 06:36:21.132707 25767 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 06:36:21.135826 25795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:21.136974 25767 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:36:21.137113 25767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "ce3010ce50c3428caf19a8aabc4f419a"
format_stamp: "Formatted at 2026-08-09 06:36:21 on dist-test-slave-cvwc"
server_key: "6c4772f4dd91e4348f291325bb092791"
server_key_iv: "189c7b5cd6e62c4e8eeebe7f35cdb629"
server_key_version: "encryptionkey@0"
I20260809 06:36:21.137280 25767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:21.154711 25767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:21.158109 25767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:21.158349 25767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:21.159206 25767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:21.160458 25767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:21.160534 25767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:21.160655 25767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:21.160707 25767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:21.191051 25767 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:34659
I20260809 06:36:21.191144 25998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:34659 every 8 connection(s)
I20260809 06:36:21.192233 25767 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:36:21.198949 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 25767
I20260809 06:36:21.199146 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:36:21.199610 31033 external_mini_cluster.cc:1428] Setting key 466d58def7bbce1ea503390f91230dbb
Aug 09 06:36:21 dist-test-slave-cvwc krb5kdc[25149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257381, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:21.210907 25533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.194536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:39947 (local address 127.30.78.126:43661)
0809 06:36:21.194753 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.194759 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.195851 (+ 1092us) server_negotiation.cc:407] Connection header received
0809 06:36:21.197584 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.197588 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.197653 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.197770 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:21.199378 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.200139 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.201820 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.202320 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.202415 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.205538 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:21.205543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:21.205547 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:21.205582 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:21.208006 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.208699 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.208705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.208707 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.208836 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.209239 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.209244 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.209247 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.209537 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:21.209669 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.210337 (+ 668us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.210559 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 06:36:21.211788 26005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.195017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:43661 (local address 127.30.78.67:39947)
0809 06:36:21.195697 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.195740 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:21.197326 (+ 1586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:21.197962 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:21.197970 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:21.198451 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:21.199209 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.199237 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.200288 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.200292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.201668 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.201683 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.202533 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.202539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.202725 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.203277 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:36:21.203303 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:21.205338 (+ 2035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:21.208137 (+ 2799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:21.208155 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:21.208169 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:21.208584 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:21.208941 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:21.208946 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:21.208950 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:21.209132 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:21.209660 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:21.209668 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:21.210008 (+ 340us) client_negotiation.cc:769] Sending connection context
0809 06:36:21.210243 (+ 235us) client_negotiation.cc:240] Negotiation successful
0809 06:36:21.210720 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":269,"threads_started":1}
I20260809 06:36:21.213065 25999 heartbeater.cc:347] Connected to a master server at 127.30.78.126:43661
I20260809 06:36:21.213366 25999 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:21.214128 25999 heartbeater.cc:511] Master 127.30.78.126:43661 requested a full tablet report, sending...
I20260809 06:36:21.215521 25224 ts_manager.cc:194] Registered new tserver with Master: ce3010ce50c3428caf19a8aabc4f419a (127.30.78.67:34659)
I20260809 06:36:21.216265 25224 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:39947
I20260809 06:36:21.216862 25530 heartbeater.cc:503] Master 127.30.78.126:43661 was elected leader, sending a full tablet report...
I20260809 06:36:21.226392 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:36:21.242749 25533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.230806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51020 (local address 127.30.78.126:43661)
0809 06:36:21.230992 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.230999 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.231380 (+ 381us) server_negotiation.cc:407] Connection header received
0809 06:36:21.231506 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.231510 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.231567 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.231640 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:21.232999 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.233670 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.234944 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.235346 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.235432 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.237518 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:21.237523 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:21.237527 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:21.237556 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:21.240214 (+ 2658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.240888 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.240894 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.240898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.241029 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.241357 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.241363 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.241374 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.241684 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:21.241955 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.242248 (+ 293us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.242462 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:36:21.246456 25224 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:36:21.253082 25224 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:36:21.284936 26031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.266623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56962 (local address 127.30.78.67:34659)
0809 06:36:21.277415 (+ 10792us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.277423 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.277545 (+ 122us) server_negotiation.cc:407] Connection header received
0809 06:36:21.277902 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.277908 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.278087 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.278275 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:21.279090 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.280635 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.282964 (+ 2329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.283835 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.283961 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.284203 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.284459 (+ 256us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.284620 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10599,"thread_start_us":10436,"threads_started":1}
I20260809 06:36:21.284936 26027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.266076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:34659 (local address 127.0.0.1:56962)
0809 06:36:21.277434 (+ 11358us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.277448 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:21.277575 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:21.278428 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:21.278432 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:21.278472 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:21.278913 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.278926 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.280793 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.280798 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.282815 (+ 2017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.282826 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.284026 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.284032 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.284211 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.284265 (+ 54us) client_negotiation.cc:769] Sending connection context
0809 06:36:21.284390 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 06:36:21.284579 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11249,"thread_start_us":9834,"threads_started":1}
I20260809 06:36:21.285279 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.264451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43202 (local address 127.30.78.65:38939)
0809 06:36:21.275853 (+ 11402us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.275862 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.276510 (+ 648us) server_negotiation.cc:407] Connection header received
0809 06:36:21.276788 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.276796 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.277075 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.277285 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:21.278263 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.279574 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.282531 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.283855 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.283986 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.284206 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.284825 (+ 619us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.284984 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11195,"thread_start_us":11415,"threads_started":1}
I20260809 06:36:21.285492 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.265096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52940 (local address 127.30.78.66:44129)
0809 06:36:21.265640 (+ 544us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.265650 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.276587 (+ 10937us) server_negotiation.cc:407] Connection header received
0809 06:36:21.277685 (+ 1098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.277694 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.277932 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.278147 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:21.278833 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.280392 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.282414 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.283840 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.283986 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.284170 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.285027 (+ 857us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.285185 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":273,"threads_started":1}
I20260809 06:36:21.286065 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.264269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38939 (local address 127.0.0.1:43202)
0809 06:36:21.276322 (+ 12053us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.276373 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:21.276572 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:21.277590 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:21.277597 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:21.277629 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:21.278073 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.278088 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.279731 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.279736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.282321 (+ 2585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.282336 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.284384 (+ 2048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.284390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.284585 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.284650 (+ 65us) client_negotiation.cc:769] Sending connection context
0809 06:36:21.285502 (+ 852us) client_negotiation.cc:240] Negotiation successful
0809 06:36:21.285628 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11777,"mutex_wait_us":93,"thread_start_us":12456,"threads_started":1}
I20260809 06:36:21.286216 26024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.264548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:44129 (local address 127.0.0.1:52940)
0809 06:36:21.276404 (+ 11856us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.276420 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:21.277470 (+ 1050us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:21.278168 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:21.278172 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:21.278197 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:21.278655 (+ 458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.278667 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.280563 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.280569 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.282263 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.282279 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.284346 (+ 2067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.284353 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.284570 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.284645 (+ 75us) client_negotiation.cc:769] Sending connection context
0809 06:36:21.284738 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 06:36:21.284855 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11751,"mutex_wait_us":57,"thread_start_us":13113,"threads_started":1}
I20260809 06:36:21.289053 25425 tablet_service.cc:1467] Processing CreateTablet for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1 (DEFAULT_TABLE table=test-table [id=cb5d48009a0b47a5a53f581ef98c7627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:21.289052 25882 tablet_service.cc:1467] Processing CreateTablet for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1 (DEFAULT_TABLE table=test-table [id=cb5d48009a0b47a5a53f581ef98c7627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:21.290566 25882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:21.290578 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:21.292057 25637 tablet_service.cc:1467] Processing CreateTablet for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1 (DEFAULT_TABLE table=test-table [id=cb5d48009a0b47a5a53f581ef98c7627]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:21.293256 25637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:21.301651 26034 tablet_bootstrap.cc:492] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: Bootstrap starting.
I20260809 06:36:21.304646 26034 tablet_bootstrap.cc:654] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:21.304719 26035 tablet_bootstrap.cc:492] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064: Bootstrap starting.
I20260809 06:36:21.306011 26034 log.cc:824] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:21.306589 26037 tablet_bootstrap.cc:492] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: Bootstrap starting.
I20260809 06:36:21.308027 26035 tablet_bootstrap.cc:654] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:21.309186 26035 log.cc:824] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:21.309466 26037 tablet_bootstrap.cc:654] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:21.310065 26034 tablet_bootstrap.cc:492] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: No bootstrap required, opened a new log
I20260809 06:36:21.310420 26034 ts_tablet_manager.cc:1397] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260809 06:36:21.310725 26037 log.cc:824] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:21.313270 26037 tablet_bootstrap.cc:492] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: No bootstrap required, opened a new log
I20260809 06:36:21.313297 26035 tablet_bootstrap.cc:492] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064: No bootstrap required, opened a new log
I20260809 06:36:21.313500 26037 ts_tablet_manager.cc:1397] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260809 06:36:21.313526 26035 ts_tablet_manager.cc:1397] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260809 06:36:21.319963 26037 raft_consensus.cc:348] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } }
I20260809 06:36:21.320297 26037 raft_consensus.cc:374] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:21.320389 26037 raft_consensus.cc:729] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82141a839b204ba495fe62a2c54d7872, State: Initialized, Role: FOLLOWER
I20260809 06:36:21.320346 26034 raft_consensus.cc:348] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } }
I20260809 06:36:21.320832 26034 raft_consensus.cc:374] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:21.320936 26034 raft_consensus.cc:729] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce3010ce50c3428caf19a8aabc4f419a, State: Initialized, Role: FOLLOWER
I20260809 06:36:21.320946 26037 consensus_queue.cc:260] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } }
I20260809 06:36:21.321499 26034 consensus_queue.cc:260] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } }
I20260809 06:36:21.322091 25757 heartbeater.cc:503] Master 127.30.78.126:43661 was elected leader, sending a full tablet report...
I20260809 06:36:21.322826 26037 ts_tablet_manager.cc:1428] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20260809 06:36:21.323525 26035 raft_consensus.cc:348] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } }
I20260809 06:36:21.323907 25999 heartbeater.cc:503] Master 127.30.78.126:43661 was elected leader, sending a full tablet report...
I20260809 06:36:21.323982 26035 raft_consensus.cc:374] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:21.324258 26035 raft_consensus.cc:729] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84bb22387fec4eb89841cce115ad4064, State: Initialized, Role: FOLLOWER
I20260809 06:36:21.324551 26034 ts_tablet_manager.cc:1428] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260809 06:36:21.324919 26035 consensus_queue.cc:260] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } }
I20260809 06:36:21.327380 26035 ts_tablet_manager.cc:1428] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064: Time spent starting tablet: real 0.014s user 0.008s sys 0.005s
W20260809 06:36:21.439747 25531 tablet.cc:2369] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:36:21.440837 25759 tablet.cc:2369] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:36:21.443848 26000 tablet.cc:2369] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:36:21.486994 26042 raft_consensus.cc:482] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:36:21.487303 26042 raft_consensus.cc:504] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } }
I20260809 06:36:21.489024 26042 leader_election.cc:288] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84bb22387fec4eb89841cce115ad4064 (127.30.78.65:38939), ce3010ce50c3428caf19a8aabc4f419a (127.30.78.67:34659)
I20260809 06:36:21.497185 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.489561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:43475 (local address 127.30.78.65:38939)
0809 06:36:21.490027 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.490033 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.490598 (+ 565us) server_negotiation.cc:407] Connection header received
0809 06:36:21.490779 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.490784 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.490854 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.490934 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:21.491499 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.492532 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.495063 (+ 2531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.496274 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.496446 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.496520 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.496804 (+ 284us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.496944 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260809 06:36:21.497238 26050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.489292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38939 (local address 127.30.78.66:43475)
0809 06:36:21.490489 (+ 1197us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.490509 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:21.490623 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:21.490980 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:21.490984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:21.491012 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:21.491351 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.491359 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.492649 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.492654 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.494917 (+ 2263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.494937 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.496489 (+ 1552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.496495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.496641 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.496670 (+ 29us) client_negotiation.cc:769] Sending connection context
0809 06:36:21.496742 (+ 72us) client_negotiation.cc:240] Negotiation successful
0809 06:36:21.496830 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1083,"mutex_wait_us":131,"thread_start_us":799,"threads_started":1}
I20260809 06:36:21.497398 26031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.489568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:43259 (local address 127.30.78.67:34659)
0809 06:36:21.489910 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.489917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.490324 (+ 407us) server_negotiation.cc:407] Connection header received
0809 06:36:21.490539 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.490543 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.490604 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.490691 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:21.491276 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.492360 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.495073 (+ 2713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.496293 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.496447 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.496520 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.497032 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.497159 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260809 06:36:21.497557 26047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.489293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:34659 (local address 127.30.78.66:43259)
0809 06:36:21.490194 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.490215 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:21.490398 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:21.490720 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:21.490725 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:21.490747 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:21.491117 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.491129 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.492494 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.492498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.494944 (+ 2446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:21.494953 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.496677 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.496682 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:21.496854 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.496889 (+ 35us) client_negotiation.cc:769] Sending connection context
0809 06:36:21.496983 (+ 94us) client_negotiation.cc:240] Negotiation successful
0809 06:36:21.497111 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"mutex_wait_us":83,"thread_start_us":532,"threads_started":1}
I20260809 06:36:21.498694 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6b39c1d7dd4f63ae0f1d288d7877e1" candidate_uuid: "82141a839b204ba495fe62a2c54d7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce3010ce50c3428caf19a8aabc4f419a" is_pre_election: true
I20260809 06:36:21.498695 25458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6b39c1d7dd4f63ae0f1d288d7877e1" candidate_uuid: "82141a839b204ba495fe62a2c54d7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84bb22387fec4eb89841cce115ad4064" is_pre_election: true
I20260809 06:36:21.499259 25916 raft_consensus.cc:2454] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82141a839b204ba495fe62a2c54d7872 in term 0.
I20260809 06:36:21.499259 25458 raft_consensus.cc:2454] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82141a839b204ba495fe62a2c54d7872 in term 0.
I20260809 06:36:21.499953 25568 leader_election.cc:302] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82141a839b204ba495fe62a2c54d7872, ce3010ce50c3428caf19a8aabc4f419a; no voters:
I20260809 06:36:21.500306 26042 raft_consensus.cc:2781] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:36:21.500450 26042 raft_consensus.cc:482] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:36:21.500550 26042 raft_consensus.cc:3037] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:21.502733 26042 raft_consensus.cc:504] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } }
I20260809 06:36:21.503237 26042 leader_election.cc:288] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [CANDIDATE]: Term 1 election: Requested vote from peers 84bb22387fec4eb89841cce115ad4064 (127.30.78.65:38939), ce3010ce50c3428caf19a8aabc4f419a (127.30.78.67:34659)
I20260809 06:36:21.503608 25458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6b39c1d7dd4f63ae0f1d288d7877e1" candidate_uuid: "82141a839b204ba495fe62a2c54d7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84bb22387fec4eb89841cce115ad4064"
I20260809 06:36:21.503640 25916 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb6b39c1d7dd4f63ae0f1d288d7877e1" candidate_uuid: "82141a839b204ba495fe62a2c54d7872" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce3010ce50c3428caf19a8aabc4f419a"
I20260809 06:36:21.503777 25458 raft_consensus.cc:3037] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:21.503803 25916 raft_consensus.cc:3037] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:21.505908 25458 raft_consensus.cc:2454] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82141a839b204ba495fe62a2c54d7872 in term 1.
I20260809 06:36:21.505960 25916 raft_consensus.cc:2454] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82141a839b204ba495fe62a2c54d7872 in term 1.
I20260809 06:36:21.506314 25568 leader_election.cc:302] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82141a839b204ba495fe62a2c54d7872, ce3010ce50c3428caf19a8aabc4f419a; no voters:
I20260809 06:36:21.506572 26042 raft_consensus.cc:2781] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:21.506971 26042 raft_consensus.cc:686] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 1 LEADER]: Becoming Leader. State: Replica: 82141a839b204ba495fe62a2c54d7872, State: Running, Role: LEADER
I20260809 06:36:21.507401 26042 consensus_queue.cc:237] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } }
I20260809 06:36:21.511868 25224 catalog_manager.cc:5495] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82141a839b204ba495fe62a2c54d7872 (127.30.78.66). New cstate: current_term: 1 leader_uuid: "82141a839b204ba495fe62a2c54d7872" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82141a839b204ba495fe62a2c54d7872" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 } health_report { overall_health: UNKNOWN } } }
I20260809 06:36:21.563938 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.559264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52946 (local address 127.30.78.66:44129)
0809 06:36:21.559473 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.559477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.559495 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:36:21.559651 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.559655 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.559729 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.559846 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:36:21.560141 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.560835 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.562149 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.562541 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.562628 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.562992 (+ 364us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:36:21.563454 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:36:21.563563 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.563600 (+ 37us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.563661 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:36:21.571506 25916 raft_consensus.cc:1261] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [term 1 FOLLOWER]: Refusing update from remote peer 82141a839b204ba495fe62a2c54d7872: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:21.571553 25458 raft_consensus.cc:1261] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [term 1 FOLLOWER]: Refusing update from remote peer 82141a839b204ba495fe62a2c54d7872: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:21.572444 26054 consensus_queue.cc:1035] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84bb22387fec4eb89841cce115ad4064" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 38939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:21.572773 26042 consensus_queue.cc:1035] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce3010ce50c3428caf19a8aabc4f419a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 34659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:21.584014 26060 mvcc.cc:205] Tried to move back new op lower bound from 7316510234907656192 to 7316510234657828864. Current Snapshot: MvccSnapshot[applied={T|T < 7316510234907656192}]
I20260809 06:36:21.586834 26065 mvcc.cc:205] Tried to move back new op lower bound from 7316510234907656192 to 7316510234657828864. Current Snapshot: MvccSnapshot[applied={T|T < 7316510234907656192}]
I20260809 06:36:21.595986 25219 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:21.596300 25219 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:21.599987 25219 catalog_manager.cc:5782] T 00000000000000000000000000000000 P faa75fcc7ede4b0fa1d945a676a130fc: Sending DeleteTablet for 3 replicas of tablet cb6b39c1d7dd4f63ae0f1d288d7877e1
I20260809 06:36:21.600979 25425 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:21 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:43202
I20260809 06:36:21.601517 25882 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:21 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:56962
I20260809 06:36:21.602715 25637 tablet_service.cc:1514] Processing DeleteTablet for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:21 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:52940
I20260809 06:36:21.606498 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 25323
I20260809 06:36:21.626642 26081 tablet_replica.cc:330] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: stopping tablet replica
I20260809 06:36:21.628669 26081 raft_consensus.cc:2229] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:36:21.629616 26078 tablet_replica.cc:330] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: stopping tablet replica
I20260809 06:36:21.632088 26078 raft_consensus.cc:2229] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:21.632944 26081 raft_consensus.cc:2258] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:21.633548 26078 raft_consensus.cc:2258] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:21.636487 26081 ts_tablet_manager.cc:1905] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:21.638581 26078 ts_tablet_manager.cc:1905] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:21.640653 26077 tablet_replica.cc:330] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064: stopping tablet replica
I20260809 06:36:21.641048 26077 raft_consensus.cc:2229] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:21.641541 26077 raft_consensus.cc:2258] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:21.644011 26077 ts_tablet_manager.cc:1905] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 84bb22387fec4eb89841cce115ad4064: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 06:36:21 dist-test-slave-cvwc krb5kdc[25149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:36:21.647977 26081 ts_tablet_manager.cc:1918] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:21.648139 26081 log.cc:1196] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/cb6b39c1d7dd4f63ae0f1d288d7877e1
I20260809 06:36:21.648710 26081 ts_tablet_manager.cc:1939] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P 82141a839b204ba495fe62a2c54d7872: Deleting consensus metadata
I20260809 06:36:21.649358 26078 ts_tablet_manager.cc:1918] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:21.649523 26078 log.cc:1196] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/cb6b39c1d7dd4f63ae0f1d288d7877e1
I20260809 06:36:21.650024 26078 ts_tablet_manager.cc:1939] T cb6b39c1d7dd4f63ae0f1d288d7877e1 P ce3010ce50c3428caf19a8aabc4f419a: Deleting consensus metadata
I20260809 06:36:21.650552 25203 catalog_manager.cc:4841] TS 82141a839b204ba495fe62a2c54d7872 (127.30.78.66:44129): tablet cb6b39c1d7dd4f63ae0f1d288d7877e1 (table test-table [id=cb5d48009a0b47a5a53f581ef98c7627]) successfully deleted
I20260809 06:36:21.652416 25205 catalog_manager.cc:4841] TS ce3010ce50c3428caf19a8aabc4f419a (127.30.78.67:34659): tablet cb6b39c1d7dd4f63ae0f1d288d7877e1 (table test-table [id=cb5d48009a0b47a5a53f581ef98c7627]) successfully deleted
I20260809 06:36:21.655287 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.607848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43212 (local address 127.30.78.65:38939)
0809 06:36:21.608027 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.608033 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.627478 (+ 19445us) server_negotiation.cc:407] Connection header received
0809 06:36:21.629054 (+ 1576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.629061 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.629169 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.629249 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:21.637085 (+ 7836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.638328 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.642065 (+ 3737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.642682 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.642826 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.648446 (+ 5620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:21.648460 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:21.648477 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:21.648517 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:21.652354 (+ 3837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.653133 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.653141 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.653144 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.653279 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.653646 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.653651 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.653655 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.654070 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:21.654356 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.654658 (+ 302us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.654885 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:36:21.655911 25522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:21.774636 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 25323
I20260809 06:36:21.795497 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 25539
W20260809 06:36:21.795496 25204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.78.65:38939 (error 108)
I20260809 06:36:21.797849 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.797007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38939 (local address 127.0.0.1:43226)
0809 06:36:21.797477 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.797620 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:38939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":251,"threads_started":1}
W20260809 06:36:21.798141 25204 catalog_manager.cc:4584] TS 84bb22387fec4eb89841cce115ad4064 (127.30.78.65:38939): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cb6b39c1d7dd4f63ae0f1d288d7877e1: Network error: Client connection negotiation failed: client connection to 127.30.78.65:38939: connect: Connection refused (error 111)
Aug 09 06:36:21 dist-test-slave-cvwc krb5kdc[25149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:36:21.811415 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.796638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52952 (local address 127.30.78.66:44129)
0809 06:36:21.796795 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.796800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.796816 (+ 16us) server_negotiation.cc:407] Connection header received
0809 06:36:21.796870 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.796874 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.796939 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.797033 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:21.798754 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.799560 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.800865 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.801305 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.801420 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.805477 (+ 4057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:21.805490 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:21.805504 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:21.805543 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:21.808611 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.809310 (+ 699us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.809318 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.809321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.809463 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.809935 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.809939 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.809941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.810288 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:21.810591 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.810871 (+ 280us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.811095 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:36:21.812019 25749 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:21.851706 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.851256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38939 (local address 127.0.0.1:43230)
0809 06:36:21.851453 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.851551 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:38939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 06:36:21.852699 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.852362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38939 (local address 127.0.0.1:43236)
0809 06:36:21.852495 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.852565 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:38939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260809 06:36:21.913092 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.912660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38939 (local address 127.0.0.1:43252)
0809 06:36:21.912864 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.912953 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:38939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 06:36:21.914106 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.913749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38939 (local address 127.0.0.1:43260)
0809 06:36:21.913890 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.913965 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:38939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260809 06:36:21.925439 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 25539
I20260809 06:36:21.950532 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 25767
Aug 09 06:36:21 dist-test-slave-cvwc krb5kdc[25149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257379, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:36:21.963922 26031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.951216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56966 (local address 127.30.78.67:34659)
0809 06:36:21.951403 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:21.951408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:21.951425 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:36:21.951561 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:21.951565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:21.951630 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:21.951709 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:21.952957 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.953660 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.954888 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:21.955251 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:21.955337 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:21.959328 (+ 3991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:21.959344 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:21.959360 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:21.959397 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:21.961705 (+ 2308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.962304 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.962311 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.962313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.962451 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:21.962719 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:21.962722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:21.962724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:21.963057 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:21.963276 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:21.963441 (+ 165us) server_negotiation.cc:299] Negotiation successful
0809 06:36:21.963596 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:36:21.964543 25986 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:21.994580 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.994154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38939 (local address 127.0.0.1:43266)
0809 06:36:21.994344 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.994439 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:38939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260809 06:36:21.995618 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:21.995230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:38939 (local address 127.0.0.1:43278)
0809 06:36:21.995411 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:21.995487 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:38939: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260809 06:36:22.053574 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 25767
I20260809 06:36:22.076090 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 25171
I20260809 06:36:22.077255 25274 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:22.184983 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 25171
2026-08-09T06:36:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4458 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-09T06:36:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:22Z Disabled control of system clock
I20260809 06:36:22.268884 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36555
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:38553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:36555
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:36:22.587467 26101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:22.587742 26101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:22.587832 26101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:22.594817 26101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:22.594921 26101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:22.594966 26101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:22.595021 26101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:22.595063 26101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:22.603827 26101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:36555
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:36555
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:22.604959 26101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:22.606645 26101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:22.617583 26110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:22.617609 26111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:22.618178 26114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:22.618292 26101 server_base.cc:1034] running on GCE node
I20260809 06:36:22.619078 26101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:22.620342 26101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:22.621521 26101 hybrid_clock.cc:648] HybridClock initialized: now 1786257382621474 us; error 43 us; skew 500 ppm
I20260809 06:36:22.621873 26101 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:22.627383 26101 webserver.cc:460] Webserver started at http://127.30.78.126:42539/ using document root <none> and password file <none>
I20260809 06:36:22.628027 26101 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:22.628119 26101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:22.628422 26101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:22.631256 26101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "420f56379f8b421896afe7361c6ee9d0"
format_stamp: "Formatted at 2026-08-09 06:36:22 on dist-test-slave-cvwc"
server_key: "1a245fbdf0d4e4fab5f707e11c25b1ce"
server_key_iv: "77b92143dd71ee3da1d2fe73fb9fe068"
server_key_version: "encryptionkey@0"
I20260809 06:36:22.632148 26101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "420f56379f8b421896afe7361c6ee9d0"
format_stamp: "Formatted at 2026-08-09 06:36:22 on dist-test-slave-cvwc"
server_key: "1a245fbdf0d4e4fab5f707e11c25b1ce"
server_key_iv: "77b92143dd71ee3da1d2fe73fb9fe068"
server_key_version: "encryptionkey@0"
I20260809 06:36:22.636965 26101 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:36:22.640190 26127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:22.641402 26101 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:36:22.641563 26101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "420f56379f8b421896afe7361c6ee9d0"
format_stamp: "Formatted at 2026-08-09 06:36:22 on dist-test-slave-cvwc"
server_key: "1a245fbdf0d4e4fab5f707e11c25b1ce"
server_key_iv: "77b92143dd71ee3da1d2fe73fb9fe068"
server_key_version: "encryptionkey@0"
I20260809 06:36:22.641788 26101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:22.658730 26101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:22.659440 26101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:22.659691 26101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:22.676297 26101 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:36555
I20260809 06:36:22.676319 26222 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:36555 every 8 connection(s)
I20260809 06:36:22.677584 26101 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:22.680065 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 26101
I20260809 06:36:22.680222 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:22.680670 31033 external_mini_cluster.cc:1428] Setting key 300e7597dafeced09fdd2dcb360f9be4
I20260809 06:36:22.681239 26223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:22.692991 26223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0: Bootstrap starting.
I20260809 06:36:22.693857 26228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:22.682459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57026 (local address 127.30.78.126:36555)
0809 06:36:22.683380 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:22.683400 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:22.683440 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:36:22.685616 (+ 2176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:22.685637 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:22.686127 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:22.686499 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:22.687046 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:22.688300 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:22.689669 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:22.690382 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:22.690570 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:22.691710 (+ 1140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:22.691718 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:22.691730 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:22.692222 (+ 492us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:22.692296 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:22.692316 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:22.692425 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:22.692635 (+ 210us) server_negotiation.cc:299] Negotiation successful
0809 06:36:22.692912 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":333,"threads_started":1}
I20260809 06:36:22.696259 26223 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:22.697244 26223 log.cc:824] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:22.699839 26223 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0: No bootstrap required, opened a new log
I20260809 06:36:22.706560 26223 raft_consensus.cc:348] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "420f56379f8b421896afe7361c6ee9d0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36555 } }
I20260809 06:36:22.706876 26223 raft_consensus.cc:374] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:22.706971 26223 raft_consensus.cc:729] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420f56379f8b421896afe7361c6ee9d0, State: Initialized, Role: FOLLOWER
I20260809 06:36:22.707489 26223 consensus_queue.cc:260] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "420f56379f8b421896afe7361c6ee9d0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36555 } }
I20260809 06:36:22.707691 26223 raft_consensus.cc:388] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:22.707808 26223 raft_consensus.cc:482] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:22.707969 26223 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:22.709924 26223 raft_consensus.cc:504] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "420f56379f8b421896afe7361c6ee9d0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36555 } }
I20260809 06:36:22.710369 26223 leader_election.cc:302] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 420f56379f8b421896afe7361c6ee9d0; no voters:
I20260809 06:36:22.710883 26223 leader_election.cc:288] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:22.711015 26234 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:22.711654 26234 raft_consensus.cc:686] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [term 1 LEADER]: Becoming Leader. State: Replica: 420f56379f8b421896afe7361c6ee9d0, State: Running, Role: LEADER
I20260809 06:36:22.712154 26234 consensus_queue.cc:237] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "420f56379f8b421896afe7361c6ee9d0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36555 } }
I20260809 06:36:22.712658 26223 sys_catalog.cc:564] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:22.715039 26237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 420f56379f8b421896afe7361c6ee9d0. Latest consensus state: current_term: 1 leader_uuid: "420f56379f8b421896afe7361c6ee9d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "420f56379f8b421896afe7361c6ee9d0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36555 } } }
I20260809 06:36:22.715564 26237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:22.716794 26236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "420f56379f8b421896afe7361c6ee9d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "420f56379f8b421896afe7361c6ee9d0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 36555 } } }
I20260809 06:36:22.717103 26236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:22.717617 26252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:22.721563 26252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:22.729027 26252 catalog_manager.cc:1347] Generated new cluster ID: cdbb3ecc1865403fbb4097d86d3fd330
I20260809 06:36:22.729133 26252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:22.759155 26252 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:22.760911 26252 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:22.769923 26252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0: Generated new TSK 0
I20260809 06:36:22.770889 26252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:22.785005 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36555
--builtin_ntp_servers=127.30.78.84:38553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:36:23.114610 26266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:23.114873 26266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:23.115022 26266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:23.122146 26266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:23.122241 26266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:23.122390 26266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:36:23.130963 26266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36555
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:23.132194 26266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:23.133917 26266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:23.146034 26274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:23.146122 26280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:23.146090 26275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:23.146852 26266 server_base.cc:1034] running on GCE node
I20260809 06:36:23.147395 26266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:23.148217 26266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:23.149421 26266 hybrid_clock.cc:648] HybridClock initialized: now 1786257383149370 us; error 33 us; skew 500 ppm
I20260809 06:36:23.149701 26266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:23.151753 26266 webserver.cc:460] Webserver started at http://127.30.78.65:33793/ using document root <none> and password file <none>
I20260809 06:36:23.152369 26266 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:23.152479 26266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:23.152761 26266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:23.155403 26266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "e3692a8d15224d40806d6227c78d3ddf"
format_stamp: "Formatted at 2026-08-09 06:36:23 on dist-test-slave-cvwc"
server_key: "87b15622a71899036ecc78406d66aa6a"
server_key_iv: "055b62e4158718ea87cb36e9f518a8d9"
server_key_version: "encryptionkey@0"
I20260809 06:36:23.156133 26266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "e3692a8d15224d40806d6227c78d3ddf"
format_stamp: "Formatted at 2026-08-09 06:36:23 on dist-test-slave-cvwc"
server_key: "87b15622a71899036ecc78406d66aa6a"
server_key_iv: "055b62e4158718ea87cb36e9f518a8d9"
server_key_version: "encryptionkey@0"
I20260809 06:36:23.160830 26266 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260809 06:36:23.164006 26287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:23.165189 26266 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:36:23.165334 26266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "e3692a8d15224d40806d6227c78d3ddf"
format_stamp: "Formatted at 2026-08-09 06:36:23 on dist-test-slave-cvwc"
server_key: "87b15622a71899036ecc78406d66aa6a"
server_key_iv: "055b62e4158718ea87cb36e9f518a8d9"
server_key_version: "encryptionkey@0"
I20260809 06:36:23.165527 26266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:23.188333 26266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:23.189066 26266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:23.189339 26266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:23.190253 26266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:23.191582 26266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:23.191676 26266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:23.191783 26266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:23.191859 26266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:23.221504 26266 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:46593
I20260809 06:36:23.221570 26469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:46593 every 8 connection(s)
I20260809 06:36:23.222779 26266 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:36:23.223054 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 26266
I20260809 06:36:23.223201 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:36:23.223762 31033 external_mini_cluster.cc:1428] Setting key ad9b7c088d32b32944e6526a474c8040
I20260809 06:36:23.227190 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36555
--builtin_ntp_servers=127.30.78.84:38553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:36:23.235632 26473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:23.225422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:47125 (local address 127.30.78.126:36555)
0809 06:36:23.225871 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:23.225877 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:23.227142 (+ 1265us) server_negotiation.cc:407] Connection header received
0809 06:36:23.228963 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:23.228968 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:23.229053 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:23.229148 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:23.230234 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:23.230936 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:23.232814 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:23.233392 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:23.233521 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:23.234829 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:23.234835 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:23.234838 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:23.234858 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:23.234914 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:23.234930 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:23.235012 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:23.235211 (+ 199us) server_negotiation.cc:299] Negotiation successful
0809 06:36:23.235306 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":195,"threads_started":1}
I20260809 06:36:23.236615 26474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:23.226091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36555 (local address 127.30.78.65:47125)
0809 06:36:23.226994 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:23.227034 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:23.228713 (+ 1679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:23.229394 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:23.229403 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:23.229492 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:23.230075 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:23.230093 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:23.231106 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:23.231111 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:23.232663 (+ 1552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:23.232676 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:23.233582 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:23.233587 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:23.233850 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:23.234506 (+ 656us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:36:23.234509 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:23.234553 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:36:23.234640 (+ 87us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:23.235009 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:23.235016 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:23.235022 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:36:23.235169 (+ 147us) client_negotiation.cc:240] Negotiation successful
0809 06:36:23.235519 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":298,"threads_started":1}
I20260809 06:36:23.238029 26471 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36555
I20260809 06:36:23.238348 26471 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:23.239169 26471 heartbeater.cc:511] Master 127.30.78.126:36555 requested a full tablet report, sending...
I20260809 06:36:23.241037 26162 ts_manager.cc:194] Registered new tserver with Master: e3692a8d15224d40806d6227c78d3ddf (127.30.78.65:46593)
I20260809 06:36:23.242561 26162 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.65:47125
W20260809 06:36:23.546447 26475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:23.546725 26475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:23.546867 26475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:23.554142 26475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:23.554242 26475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:23.554412 26475 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:36:23.563386 26475 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36555
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:23.564570 26475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:23.566371 26475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:23.579456 26483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:23.579507 26486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:23.579532 26482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:23.580574 26475 server_base.cc:1034] running on GCE node
I20260809 06:36:23.581152 26475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:23.582072 26475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:23.583264 26475 hybrid_clock.cc:648] HybridClock initialized: now 1786257383583208 us; error 48 us; skew 500 ppm
I20260809 06:36:23.583555 26475 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:23.585637 26475 webserver.cc:460] Webserver started at http://127.30.78.66:33751/ using document root <none> and password file <none>
I20260809 06:36:23.586287 26475 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:23.586390 26475 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:23.586699 26475 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:23.589385 26475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "0f616672a26147e79a920ea683f02786"
format_stamp: "Formatted at 2026-08-09 06:36:23 on dist-test-slave-cvwc"
server_key: "30a0e8ecc84a277be88408746e824b4c"
server_key_iv: "1df3de133e6dd550c05eddc7c7a7782a"
server_key_version: "encryptionkey@0"
I20260809 06:36:23.590167 26475 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "0f616672a26147e79a920ea683f02786"
format_stamp: "Formatted at 2026-08-09 06:36:23 on dist-test-slave-cvwc"
server_key: "30a0e8ecc84a277be88408746e824b4c"
server_key_iv: "1df3de133e6dd550c05eddc7c7a7782a"
server_key_version: "encryptionkey@0"
I20260809 06:36:23.594905 26475 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:36:23.598023 26493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:23.599200 26475 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:23.599349 26475 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "0f616672a26147e79a920ea683f02786"
format_stamp: "Formatted at 2026-08-09 06:36:23 on dist-test-slave-cvwc"
server_key: "30a0e8ecc84a277be88408746e824b4c"
server_key_iv: "1df3de133e6dd550c05eddc7c7a7782a"
server_key_version: "encryptionkey@0"
I20260809 06:36:23.599535 26475 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:23.610740 26475 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:23.611449 26475 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:23.611716 26475 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:23.612612 26475 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:23.614044 26475 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:23.614140 26475 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:23.614243 26475 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:23.614312 26475 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:23.644055 26475 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:41717
I20260809 06:36:23.644119 26692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:41717 every 8 connection(s)
I20260809 06:36:23.645318 26475 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:36:23.654125 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 26475
I20260809 06:36:23.654320 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:36:23.654799 31033 external_mini_cluster.cc:1428] Setting key 1a8ac2c6e2600d51c2ae225e44a86166
I20260809 06:36:23.657142 26473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:23.647780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:56621 (local address 127.30.78.126:36555)
0809 06:36:23.647987 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:23.647994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:23.649308 (+ 1314us) server_negotiation.cc:407] Connection header received
0809 06:36:23.651046 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:23.651050 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:23.651117 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:23.651193 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:23.652143 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:23.652857 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:23.654559 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:23.654960 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:23.655056 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:23.656372 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:23.656386 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:23.656389 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:23.656405 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:23.656437 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:23.656449 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:23.656521 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:23.656733 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 06:36:23.656828 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:36:23.657485 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36555
--builtin_ntp_servers=127.30.78.84:38553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:36:23.658170 26695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:23.648313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36555 (local address 127.30.78.66:56621)
0809 06:36:23.649163 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:23.649205 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:23.650799 (+ 1594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:23.651362 (+ 563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:23.651370 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:23.651455 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:23.652010 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:23.652026 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:23.652963 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:23.652966 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:23.654423 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:23.654438 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:23.655173 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:23.655181 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:23.655427 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:23.656081 (+ 654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:36:23.656084 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:23.656126 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:36:23.656195 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:23.656536 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:23.656547 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:23.656555 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 06:36:23.656714 (+ 159us) client_negotiation.cc:240] Negotiation successful
0809 06:36:23.657069 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":267,"threads_started":1}
I20260809 06:36:23.659428 26693 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36555
I20260809 06:36:23.659710 26693 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:23.660502 26693 heartbeater.cc:511] Master 127.30.78.126:36555 requested a full tablet report, sending...
I20260809 06:36:23.661929 26162 ts_manager.cc:194] Registered new tserver with Master: 0f616672a26147e79a920ea683f02786 (127.30.78.66:41717)
I20260809 06:36:23.662850 26162 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.66:56621
W20260809 06:36:23.992255 26696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:23.992539 26696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:23.992697 26696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:24.000772 26696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:24.000886 26696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:24.001050 26696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:36:24.010754 26696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:38553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:36555
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:24.012248 26696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:24.014220 26696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:24.026552 26708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:24.026583 26712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:24.026611 26709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:24.027601 26696 server_base.cc:1034] running on GCE node
I20260809 06:36:24.028126 26696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:24.028952 26696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:24.030149 26696 hybrid_clock.cc:648] HybridClock initialized: now 1786257384030100 us; error 43 us; skew 500 ppm
I20260809 06:36:24.030423 26696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:24.032418 26696 webserver.cc:460] Webserver started at http://127.30.78.67:36347/ using document root <none> and password file <none>
I20260809 06:36:24.033030 26696 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:24.033115 26696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:24.033363 26696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:24.036008 26696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "ec2e76be96894248b01fadc6ad49e123"
format_stamp: "Formatted at 2026-08-09 06:36:24 on dist-test-slave-cvwc"
server_key: "ac3e08a8db53327be2f91f35f64c6299"
server_key_iv: "516415dc6b8bbba0939e52d8d03b38ee"
server_key_version: "encryptionkey@0"
I20260809 06:36:24.036700 26696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "ec2e76be96894248b01fadc6ad49e123"
format_stamp: "Formatted at 2026-08-09 06:36:24 on dist-test-slave-cvwc"
server_key: "ac3e08a8db53327be2f91f35f64c6299"
server_key_iv: "516415dc6b8bbba0939e52d8d03b38ee"
server_key_version: "encryptionkey@0"
I20260809 06:36:24.041275 26696 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:36:24.044564 26720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:24.045826 26696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:36:24.045955 26696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "ec2e76be96894248b01fadc6ad49e123"
format_stamp: "Formatted at 2026-08-09 06:36:24 on dist-test-slave-cvwc"
server_key: "ac3e08a8db53327be2f91f35f64c6299"
server_key_iv: "516415dc6b8bbba0939e52d8d03b38ee"
server_key_version: "encryptionkey@0"
I20260809 06:36:24.046123 26696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:24.071931 26696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:24.072633 26696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:24.072883 26696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:24.073807 26696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:24.075152 26696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:24.075238 26696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:24.075321 26696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:24.075376 26696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:24.104429 26696 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:39855
I20260809 06:36:24.104498 26898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:39855 every 8 connection(s)
I20260809 06:36:24.105630 26696 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:36:24.113873 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 26696
I20260809 06:36:24.114034 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:36:24.114475 31033 external_mini_cluster.cc:1428] Setting key 86142282f1791851c8d3351fdc6648b3
I20260809 06:36:24.117798 26473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.108006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:50129 (local address 127.30.78.126:36555)
0809 06:36:24.108163 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.108167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.109478 (+ 1311us) server_negotiation.cc:407] Connection header received
0809 06:36:24.111275 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.111281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.111358 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.111449 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:24.112541 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.113369 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.114984 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.115539 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.115660 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.117001 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:24.117008 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:24.117013 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:24.117034 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:24.117075 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:24.117092 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:24.117171 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.117444 (+ 273us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.117521 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 06:36:24.118736 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.108468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:36555 (local address 127.30.78.67:50129)
0809 06:36:24.109314 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:24.109349 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:24.111010 (+ 1661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:24.111681 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:24.111689 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:24.111773 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:24.112375 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.112399 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.113517 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.113521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.114846 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.114859 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.115752 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.115758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.115976 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.116672 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:36:24.116675 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:24.116733 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:36:24.116829 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:24.117222 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:24.117231 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:24.117237 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:36:24.117425 (+ 188us) client_negotiation.cc:240] Negotiation successful
0809 06:36:24.117698 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":262,"threads_started":1}
I20260809 06:36:24.119951 26899 heartbeater.cc:347] Connected to a master server at 127.30.78.126:36555
I20260809 06:36:24.120237 26899 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:24.120990 26899 heartbeater.cc:511] Master 127.30.78.126:36555 requested a full tablet report, sending...
I20260809 06:36:24.122288 26162 ts_manager.cc:194] Registered new tserver with Master: ec2e76be96894248b01fadc6ad49e123 (127.30.78.67:39855)
I20260809 06:36:24.123044 26162 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.67:50129
I20260809 06:36:24.129132 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:36:24.138115 26473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.132928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57028 (local address 127.30.78.126:36555)
0809 06:36:24.133109 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.133116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.133519 (+ 403us) server_negotiation.cc:407] Connection header received
0809 06:36:24.133633 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.133637 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.133702 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.133805 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:24.134200 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.134851 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.136134 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.136511 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.136600 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.137551 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:24.137556 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:24.137559 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:24.137574 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:24.137603 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:24.137613 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:24.137675 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.137788 (+ 113us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.137856 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:36:24.141276 26162 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57028:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:36:24.148001 26162 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:36:24.169809 26917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.158702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42932 (local address 127.30.78.67:39855)
0809 06:36:24.161346 (+ 2644us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.161354 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.161401 (+ 47us) server_negotiation.cc:407] Connection header received
0809 06:36:24.161498 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.161506 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.162552 (+ 1046us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.162745 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:24.163533 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.164893 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.167413 (+ 2520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.168716 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.168831 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.169090 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.169301 (+ 211us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.169471 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2484,"thread_start_us":2328,"threads_started":1}
I20260809 06:36:24.169900 26916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.158507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:39855 (local address 127.0.0.1:42932)
0809 06:36:24.159576 (+ 1069us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:24.159627 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:24.159788 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:24.162975 (+ 3187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:24.162981 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:24.163020 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:24.163357 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.163369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.165008 (+ 1639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.165013 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.167185 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.167201 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.168893 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.168899 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.169090 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.169141 (+ 51us) client_negotiation.cc:769] Sending connection context
0809 06:36:24.169247 (+ 106us) client_negotiation.cc:240] Negotiation successful
0809 06:36:24.169420 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"thread_start_us":684,"threads_started":1}
I20260809 06:36:24.170477 26920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.159210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48828 (local address 127.30.78.66:41717)
0809 06:36:24.160881 (+ 1671us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.160889 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.162406 (+ 1517us) server_negotiation.cc:407] Connection header received
0809 06:36:24.163082 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.163090 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.163307 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.163505 (+ 198us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:24.163998 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.165382 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.167781 (+ 2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.168910 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.169034 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.169239 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.169995 (+ 756us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.170164 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1501,"thread_start_us":1993,"threads_started":1}
I20260809 06:36:24.170917 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.158918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41717 (local address 127.0.0.1:48828)
0809 06:36:24.162132 (+ 3214us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:24.162149 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:24.162266 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:24.163532 (+ 1266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:24.163536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:24.163558 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:24.163838 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.163846 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.165517 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.165523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.167613 (+ 2090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.167624 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.169372 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.169379 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.169568 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.169600 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:36:24.169685 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 06:36:24.169827 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3074,"thread_start_us":3086,"threads_started":1}
I20260809 06:36:24.171015 26922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.160553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:46593 (local address 127.0.0.1:36162)
0809 06:36:24.162951 (+ 2398us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:24.162968 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:24.163079 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:24.163977 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:24.163982 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:24.164008 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:24.164409 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.164421 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.166096 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.166101 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.168120 (+ 2019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.168135 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.170334 (+ 2199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.170340 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.170519 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.170550 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 06:36:24.170636 (+ 86us) client_negotiation.cc:240] Negotiation successful
0809 06:36:24.170759 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2276,"thread_start_us":2127,"threads_started":1}
I20260809 06:36:24.171628 26923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.160818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36162 (local address 127.30.78.65:46593)
0809 06:36:24.162540 (+ 1722us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.162556 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.163210 (+ 654us) server_negotiation.cc:407] Connection header received
0809 06:36:24.163310 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.163318 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.163532 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.163713 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:24.164570 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.165918 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.168314 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.169848 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.169987 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.170205 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.171122 (+ 917us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.171281 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1572,"thread_start_us":1449,"threads_started":1}
I20260809 06:36:24.174537 26367 tablet_service.cc:1467] Processing CreateTablet for tablet f04334fe0cd74ddabedbc4043e6e019c (DEFAULT_TABLE table=test-table [id=76e7c2cb9d1d4f369136a80930e9b073]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:24.174547 26580 tablet_service.cc:1467] Processing CreateTablet for tablet f04334fe0cd74ddabedbc4043e6e019c (DEFAULT_TABLE table=test-table [id=76e7c2cb9d1d4f369136a80930e9b073]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:24.174547 26793 tablet_service.cc:1467] Processing CreateTablet for tablet f04334fe0cd74ddabedbc4043e6e019c (DEFAULT_TABLE table=test-table [id=76e7c2cb9d1d4f369136a80930e9b073]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:24.175671 26367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f04334fe0cd74ddabedbc4043e6e019c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:24.175835 26793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f04334fe0cd74ddabedbc4043e6e019c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:24.175838 26580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f04334fe0cd74ddabedbc4043e6e019c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:24.186235 26924 tablet_bootstrap.cc:492] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: Bootstrap starting.
I20260809 06:36:24.189704 26926 tablet_bootstrap.cc:492] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: Bootstrap starting.
I20260809 06:36:24.189265 26924 tablet_bootstrap.cc:654] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:24.191231 26927 tablet_bootstrap.cc:492] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: Bootstrap starting.
I20260809 06:36:24.191481 26924 log.cc:824] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:24.193941 26924 tablet_bootstrap.cc:492] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: No bootstrap required, opened a new log
I20260809 06:36:24.194173 26924 ts_tablet_manager.cc:1397] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 06:36:24.194574 26927 tablet_bootstrap.cc:654] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:24.195401 26926 tablet_bootstrap.cc:654] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:24.195740 26927 log.cc:824] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:24.196534 26926 log.cc:824] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:24.198632 26927 tablet_bootstrap.cc:492] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: No bootstrap required, opened a new log
I20260809 06:36:24.198930 26927 ts_tablet_manager.cc:1397] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 06:36:24.199159 26926 tablet_bootstrap.cc:492] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: No bootstrap required, opened a new log
I20260809 06:36:24.199393 26926 ts_tablet_manager.cc:1397] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260809 06:36:24.203290 26924 raft_consensus.cc:348] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } }
I20260809 06:36:24.203684 26924 raft_consensus.cc:374] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:24.203779 26924 raft_consensus.cc:729] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3692a8d15224d40806d6227c78d3ddf, State: Initialized, Role: FOLLOWER
I20260809 06:36:24.204360 26924 consensus_queue.cc:260] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } }
I20260809 06:36:24.205423 26471 heartbeater.cc:503] Master 127.30.78.126:36555 was elected leader, sending a full tablet report...
I20260809 06:36:24.206024 26924 ts_tablet_manager.cc:1428] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260809 06:36:24.207019 26926 raft_consensus.cc:348] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } }
I20260809 06:36:24.207365 26926 raft_consensus.cc:374] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:24.207470 26926 raft_consensus.cc:729] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f616672a26147e79a920ea683f02786, State: Initialized, Role: FOLLOWER
I20260809 06:36:24.207974 26926 consensus_queue.cc:260] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } }
I20260809 06:36:24.208360 26927 raft_consensus.cc:348] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } }
I20260809 06:36:24.208825 26927 raft_consensus.cc:374] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:24.208972 26927 raft_consensus.cc:729] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec2e76be96894248b01fadc6ad49e123, State: Initialized, Role: FOLLOWER
I20260809 06:36:24.209550 26927 consensus_queue.cc:260] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } }
I20260809 06:36:24.210636 26899 heartbeater.cc:503] Master 127.30.78.126:36555 was elected leader, sending a full tablet report...
I20260809 06:36:24.211074 26927 ts_tablet_manager.cc:1428] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260809 06:36:24.212147 26693 heartbeater.cc:503] Master 127.30.78.126:36555 was elected leader, sending a full tablet report...
I20260809 06:36:24.213011 26926 ts_tablet_manager.cc:1428] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
W20260809 06:36:24.224817 26472 tablet.cc:2369] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:36:24.286074 26940 raft_consensus.cc:482] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:36:24.286386 26940 raft_consensus.cc:504] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } }
I20260809 06:36:24.288061 26940 leader_election.cc:288] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f616672a26147e79a920ea683f02786 (127.30.78.66:41717), e3692a8d15224d40806d6227c78d3ddf (127.30.78.65:46593)
I20260809 06:36:24.294189 26923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.288488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:34661 (local address 127.30.78.65:46593)
0809 06:36:24.288850 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.288855 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.288874 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:36:24.288977 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.288982 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.289054 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.289129 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:24.289607 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.290562 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.292417 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.293355 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.293472 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.293522 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.293856 (+ 334us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.293946 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230}
I20260809 06:36:24.294260 26901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.288488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:46593 (local address 127.30.78.67:34661)
0809 06:36:24.288693 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:24.288712 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:24.288838 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:24.289217 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:24.289222 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:24.289254 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:24.289445 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.289458 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.290700 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.290706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.292253 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.292266 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.293505 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.293511 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.293673 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.293740 (+ 67us) client_negotiation.cc:769] Sending connection context
0809 06:36:24.293827 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 06:36:24.293968 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260809 06:36:24.294824 26920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.288527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:37501 (local address 127.30.78.66:41717)
0809 06:36:24.288717 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.288723 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.289364 (+ 641us) server_negotiation.cc:407] Connection header received
0809 06:36:24.289509 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.289514 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.289607 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.289675 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:24.290299 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.291141 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.293019 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.293956 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.294094 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.294159 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.294444 (+ 285us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.294562 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:36:24.294857 26942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.288528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:41717 (local address 127.30.78.67:37501)
0809 06:36:24.289259 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:24.289273 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:24.289389 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:24.289743 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:24.289748 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:24.289774 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:24.290150 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.290162 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.291293 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.291296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.292830 (+ 1534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:24.292845 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.294116 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.294121 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:24.294295 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.294325 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:36:24.294414 (+ 89us) client_negotiation.cc:240] Negotiation successful
0809 06:36:24.294529 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"mutex_wait_us":2,"thread_start_us":418,"threads_started":1}
I20260809 06:36:24.295356 26394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f04334fe0cd74ddabedbc4043e6e019c" candidate_uuid: "ec2e76be96894248b01fadc6ad49e123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3692a8d15224d40806d6227c78d3ddf" is_pre_election: true
I20260809 06:36:24.295652 26612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f04334fe0cd74ddabedbc4043e6e019c" candidate_uuid: "ec2e76be96894248b01fadc6ad49e123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f616672a26147e79a920ea683f02786" is_pre_election: true
I20260809 06:36:24.295807 26394 raft_consensus.cc:2454] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec2e76be96894248b01fadc6ad49e123 in term 0.
I20260809 06:36:24.296103 26612 raft_consensus.cc:2454] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec2e76be96894248b01fadc6ad49e123 in term 0.
I20260809 06:36:24.296452 26725 leader_election.cc:302] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3692a8d15224d40806d6227c78d3ddf, ec2e76be96894248b01fadc6ad49e123; no voters:
I20260809 06:36:24.296790 26940 raft_consensus.cc:2781] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:36:24.296914 26940 raft_consensus.cc:482] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:36:24.297013 26940 raft_consensus.cc:3037] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:24.299196 26940 raft_consensus.cc:504] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } }
I20260809 06:36:24.299777 26940 leader_election.cc:288] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [CANDIDATE]: Term 1 election: Requested vote from peers 0f616672a26147e79a920ea683f02786 (127.30.78.66:41717), e3692a8d15224d40806d6227c78d3ddf (127.30.78.65:46593)
I20260809 06:36:24.300134 26612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f04334fe0cd74ddabedbc4043e6e019c" candidate_uuid: "ec2e76be96894248b01fadc6ad49e123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f616672a26147e79a920ea683f02786"
I20260809 06:36:24.300196 26394 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f04334fe0cd74ddabedbc4043e6e019c" candidate_uuid: "ec2e76be96894248b01fadc6ad49e123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3692a8d15224d40806d6227c78d3ddf"
I20260809 06:36:24.300300 26612 raft_consensus.cc:3037] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:24.300357 26394 raft_consensus.cc:3037] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:24.302511 26394 raft_consensus.cc:2454] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec2e76be96894248b01fadc6ad49e123 in term 1.
I20260809 06:36:24.302510 26612 raft_consensus.cc:2454] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec2e76be96894248b01fadc6ad49e123 in term 1.
I20260809 06:36:24.302850 26723 leader_election.cc:302] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f616672a26147e79a920ea683f02786, ec2e76be96894248b01fadc6ad49e123; no voters:
I20260809 06:36:24.303148 26940 raft_consensus.cc:2781] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:24.303548 26940 raft_consensus.cc:686] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 1 LEADER]: Becoming Leader. State: Replica: ec2e76be96894248b01fadc6ad49e123, State: Running, Role: LEADER
I20260809 06:36:24.304051 26940 consensus_queue.cc:237] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } }
I20260809 06:36:24.308431 26161 catalog_manager.cc:5495] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec2e76be96894248b01fadc6ad49e123 (127.30.78.67). New cstate: current_term: 1 leader_uuid: "ec2e76be96894248b01fadc6ad49e123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec2e76be96894248b01fadc6ad49e123" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 39855 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 } health_report { overall_health: UNKNOWN } } }
W20260809 06:36:24.357185 26900 tablet.cc:2369] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:36:24.358855 26917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.353745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42946 (local address 127.30.78.67:39855)
0809 06:36:24.353944 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.353950 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.353969 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:36:24.354116 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.354120 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.354196 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.354320 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:36:24.354681 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.355382 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.356729 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.357187 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.357296 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.357815 (+ 519us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:36:24.358293 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:36:24.358432 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.358550 (+ 118us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.358627 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:36:24.366828 26612 raft_consensus.cc:1261] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [term 1 FOLLOWER]: Refusing update from remote peer ec2e76be96894248b01fadc6ad49e123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:24.366828 26394 raft_consensus.cc:1261] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [term 1 FOLLOWER]: Refusing update from remote peer ec2e76be96894248b01fadc6ad49e123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:24.367822 26943 consensus_queue.cc:1035] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f616672a26147e79a920ea683f02786" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 41717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:24.368126 26940 consensus_queue.cc:1035] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3692a8d15224d40806d6227c78d3ddf" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 46593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:24.392932 26161 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:24.393229 26161 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57028:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:24.396718 26161 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 420f56379f8b421896afe7361c6ee9d0: Sending DeleteTablet for 3 replicas of tablet f04334fe0cd74ddabedbc4043e6e019c
I20260809 06:36:24.398001 26580 tablet_service.cc:1514] Processing DeleteTablet for tablet f04334fe0cd74ddabedbc4043e6e019c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:24 UTC) from {username='slave'} at 127.0.0.1:48828
I20260809 06:36:24.398103 26793 tablet_service.cc:1514] Processing DeleteTablet for tablet f04334fe0cd74ddabedbc4043e6e019c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:24 UTC) from {username='slave'} at 127.0.0.1:42932
I20260809 06:36:24.398840 26367 tablet_service.cc:1514] Processing DeleteTablet for tablet f04334fe0cd74ddabedbc4043e6e019c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:24 UTC) from {username='slave'} at 127.0.0.1:36162
I20260809 06:36:24.400199 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 26266
I20260809 06:36:24.400337 26966 tablet_replica.cc:330] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: stopping tablet replica
I20260809 06:36:24.400740 26966 raft_consensus.cc:2229] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:24.401206 26966 raft_consensus.cc:2258] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:24.405203 26966 ts_tablet_manager.cc:1905] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:24.410413 26965 tablet_replica.cc:330] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: stopping tablet replica
I20260809 06:36:24.410928 26965 raft_consensus.cc:2229] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:36:24.411645 26965 raft_consensus.cc:2258] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:24.412626 26963 tablet_replica.cc:330] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: stopping tablet replica
I20260809 06:36:24.413039 26963 raft_consensus.cc:2229] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:24.413524 26963 raft_consensus.cc:2258] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:24.413879 26965 ts_tablet_manager.cc:1905] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:24.420305 26966 ts_tablet_manager.cc:1918] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:24.420544 26966 log.cc:1196] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/f04334fe0cd74ddabedbc4043e6e019c
I20260809 06:36:24.420987 26963 ts_tablet_manager.cc:1905] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:24.421144 26966 ts_tablet_manager.cc:1939] T f04334fe0cd74ddabedbc4043e6e019c P e3692a8d15224d40806d6227c78d3ddf: Deleting consensus metadata
I20260809 06:36:24.421525 26965 ts_tablet_manager.cc:1918] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:24.421736 26965 log.cc:1196] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/f04334fe0cd74ddabedbc4043e6e019c
I20260809 06:36:24.422322 26965 ts_tablet_manager.cc:1939] T f04334fe0cd74ddabedbc4043e6e019c P ec2e76be96894248b01fadc6ad49e123: Deleting consensus metadata
I20260809 06:36:24.423249 26923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.401395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36176 (local address 127.30.78.65:46593)
0809 06:36:24.401576 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.401583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.414257 (+ 12674us) server_negotiation.cc:407] Connection header received
0809 06:36:24.414437 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.414442 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.414540 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.414662 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:24.415291 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.416348 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.418257 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.418961 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.419057 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.421526 (+ 2469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:24.421536 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:24.421552 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:24.422325 (+ 773us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:24.422383 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:24.422414 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:24.422503 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.422771 (+ 268us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.422895 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:36:24.423278 26139 catalog_manager.cc:4841] TS e3692a8d15224d40806d6227c78d3ddf (127.30.78.65:46593): tablet f04334fe0cd74ddabedbc4043e6e019c (table test-table [id=76e7c2cb9d1d4f369136a80930e9b073]) successfully deleted
I20260809 06:36:24.424086 26130 catalog_manager.cc:4841] TS ec2e76be96894248b01fadc6ad49e123 (127.30.78.67:39855): tablet f04334fe0cd74ddabedbc4043e6e019c (table test-table [id=76e7c2cb9d1d4f369136a80930e9b073]) successfully deleted
I20260809 06:36:24.424533 26464 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:24.431119 26963 ts_tablet_manager.cc:1918] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:24.431273 26963 log.cc:1196] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/f04334fe0cd74ddabedbc4043e6e019c
I20260809 06:36:24.431788 26963 ts_tablet_manager.cc:1939] T f04334fe0cd74ddabedbc4043e6e019c P 0f616672a26147e79a920ea683f02786: Deleting consensus metadata
I20260809 06:36:24.433460 26132 catalog_manager.cc:4841] TS 0f616672a26147e79a920ea683f02786 (127.30.78.66:41717): tablet f04334fe0cd74ddabedbc4043e6e019c (table test-table [id=76e7c2cb9d1d4f369136a80930e9b073]) successfully deleted
I20260809 06:36:24.512612 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 26266
I20260809 06:36:24.535027 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 26475
I20260809 06:36:24.541896 26920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.535856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48842 (local address 127.30.78.66:41717)
0809 06:36:24.536034 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.536039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.536101 (+ 62us) server_negotiation.cc:407] Connection header received
0809 06:36:24.536291 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.536298 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.536399 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.536488 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:24.536896 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.537640 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.538937 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.539331 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.539439 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.540449 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:24.540458 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:24.540472 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:24.541081 (+ 609us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:24.541128 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:24.541148 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:24.541246 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.541383 (+ 137us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.541490 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:36:24.542548 26687 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:24.662117 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 26475
I20260809 06:36:24.684669 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 26696
I20260809 06:36:24.691730 26917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:24.685404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42948 (local address 127.30.78.67:39855)
0809 06:36:24.685595 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:24.685601 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:24.685748 (+ 147us) server_negotiation.cc:407] Connection header received
0809 06:36:24.685946 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:24.685951 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:24.686043 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:24.686144 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:24.686565 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.687350 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.688657 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:24.689088 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:24.689201 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:24.690312 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:24.690324 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:24.690340 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:24.690959 (+ 619us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:24.691007 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:24.691027 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:24.691131 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:24.691264 (+ 133us) server_negotiation.cc:299] Negotiation successful
0809 06:36:24.691365 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:36:24.692440 26893 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:24.811579 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 26696
I20260809 06:36:24.835204 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 26101
I20260809 06:36:24.836268 26217 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:24.942312 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 26101
2026-08-09T06:36:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2752 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:25 dist-test-slave-cvwc krb5kdc[26977](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:25 dist-test-slave-cvwc krb5kdc[26977](info): set up 2 sockets
Aug 09 06:36:25 dist-test-slave-cvwc krb5kdc[26977](info): commencing operation
krb5kdc: starting...
W20260809 06:36:26.160800 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:26 dist-test-slave-cvwc krb5kdc[26977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:36:26.406594 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:40607
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:40607
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:26.729267 26999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:26.729527 26999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:26.729622 26999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:26.736487 26999 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:26.736577 26999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:26.736629 26999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:26.736689 26999 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:26.736732 26999 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:26.745891 26999 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:40607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:40607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:26.746963 26999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:26.748142 26999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:26.759105 27005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:26.759044 27009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:26.759054 27007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:26.760012 26999 server_base.cc:1034] running on GCE node
I20260809 06:36:26.760735 26999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:26.762075 26999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:26.763278 26999 hybrid_clock.cc:648] HybridClock initialized: now 1786257386763225 us; error 39 us; skew 500 ppm
I20260809 06:36:26.763602 26999 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:26 dist-test-slave-cvwc krb5kdc[26977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257386, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:26.766535 26999 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:36:26.767943 26999 webserver.cc:460] Webserver started at http://127.30.78.126:34713/ using document root <none> and password file <none>
I20260809 06:36:26.768546 26999 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:26.768644 26999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:26.768903 26999 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:26.771723 26999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "926125d8b95c4502a32778903a8b9d5e"
format_stamp: "Formatted at 2026-08-09 06:36:26 on dist-test-slave-cvwc"
server_key: "a00cf0f3b9757656af1195ded522143f"
server_key_iv: "a7bf94170efc623d370878dd65bc52fc"
server_key_version: "encryptionkey@0"
I20260809 06:36:26.772497 26999 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "926125d8b95c4502a32778903a8b9d5e"
format_stamp: "Formatted at 2026-08-09 06:36:26 on dist-test-slave-cvwc"
server_key: "a00cf0f3b9757656af1195ded522143f"
server_key_iv: "a7bf94170efc623d370878dd65bc52fc"
server_key_version: "encryptionkey@0"
I20260809 06:36:26.777339 26999 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260809 06:36:26.780570 27018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:26.781834 26999 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:36:26.781977 26999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "926125d8b95c4502a32778903a8b9d5e"
format_stamp: "Formatted at 2026-08-09 06:36:26 on dist-test-slave-cvwc"
server_key: "a00cf0f3b9757656af1195ded522143f"
server_key_iv: "a7bf94170efc623d370878dd65bc52fc"
server_key_version: "encryptionkey@0"
I20260809 06:36:26.782138 26999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:26.802930 26999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:26.806458 26999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:26.806674 26999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:26.823355 26999 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:40607
I20260809 06:36:26.823385 27095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:40607 every 8 connection(s)
I20260809 06:36:26.824571 26999 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:26.826116 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 26999
I20260809 06:36:26.826297 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:26.826818 31033 external_mini_cluster.cc:1428] Setting key 8a26dad9935f5c7c853bbff4ff083e15
I20260809 06:36:26.828853 27099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:36:26 dist-test-slave-cvwc krb5kdc[26977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:26.841252 27099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e: Bootstrap starting.
I20260809 06:36:26.844998 27099 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:26.846331 27099 log.cc:824] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:26.851262 27102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:26.828568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58774 (local address 127.30.78.126:40607)
0809 06:36:26.829286 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:26.829300 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:26.829346 (+ 46us) server_negotiation.cc:407] Connection header received
0809 06:36:26.831516 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:26.831543 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:26.832022 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:26.832439 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:26.833690 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:26.835682 (+ 1992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:26.836925 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:26.837970 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:26.838145 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:26.842052 (+ 3907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:26.842062 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:26.842078 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:26.842119 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:26.845794 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:26.846638 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:26.846676 (+ 38us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:26.846686 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:26.847022 (+ 336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:26.847481 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:26.847488 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:26.847491 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:26.848210 (+ 719us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:26.848518 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:26.849524 (+ 1006us) server_negotiation.cc:299] Negotiation successful
0809 06:36:26.849978 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":505,"thread_start_us":315,"threads_started":1}
I20260809 06:36:26.852228 27099 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e: No bootstrap required, opened a new log
I20260809 06:36:26.862656 27099 raft_consensus.cc:348] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926125d8b95c4502a32778903a8b9d5e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40607 } }
I20260809 06:36:26.863055 27099 raft_consensus.cc:374] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:26.863212 27099 raft_consensus.cc:729] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 926125d8b95c4502a32778903a8b9d5e, State: Initialized, Role: FOLLOWER
I20260809 06:36:26.863811 27099 consensus_queue.cc:260] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926125d8b95c4502a32778903a8b9d5e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40607 } }
I20260809 06:36:26.864058 27099 raft_consensus.cc:388] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:26.864176 27099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:26.864332 27099 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:26.866474 27099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926125d8b95c4502a32778903a8b9d5e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40607 } }
I20260809 06:36:26.866897 27099 leader_election.cc:302] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 926125d8b95c4502a32778903a8b9d5e; no voters:
I20260809 06:36:26.867383 27099 leader_election.cc:288] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:26.867489 27112 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:26.868095 27112 raft_consensus.cc:686] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [term 1 LEADER]: Becoming Leader. State: Replica: 926125d8b95c4502a32778903a8b9d5e, State: Running, Role: LEADER
I20260809 06:36:26.868616 27112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926125d8b95c4502a32778903a8b9d5e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40607 } }
I20260809 06:36:26.869242 27099 sys_catalog.cc:564] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:26.871172 27113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "926125d8b95c4502a32778903a8b9d5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926125d8b95c4502a32778903a8b9d5e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40607 } } }
I20260809 06:36:26.871572 27113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:26.872259 27114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 926125d8b95c4502a32778903a8b9d5e. Latest consensus state: current_term: 1 leader_uuid: "926125d8b95c4502a32778903a8b9d5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "926125d8b95c4502a32778903a8b9d5e" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 40607 } } }
I20260809 06:36:26.872510 27114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:26.873211 27120 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:26.878144 27120 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:26.887703 27120 catalog_manager.cc:1347] Generated new cluster ID: 5c0e1adbbcce433c80f0153908bdeb19
I20260809 06:36:26.887789 27120 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:26.913220 27120 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:26.914502 27120 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:26.923930 27120 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e: Generated new TSK 0
I20260809 06:36:26.924887 27120 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:36:26.998487 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40607
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:27.318682 27144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:27.318938 27144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:27.319070 27144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:27.325973 27144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:27.326071 27144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:27.326225 27144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:36:27.335305 27144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:27.336470 27144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:27.337707 27144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:27.349684 27156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:27.349799 27154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:27.349812 27161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:27.351253 27144 server_base.cc:1034] running on GCE node
I20260809 06:36:27.351800 27144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:27.352650 27144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:27.353797 27144 hybrid_clock.cc:648] HybridClock initialized: now 1786257387353733 us; error 53 us; skew 500 ppm
I20260809 06:36:27.354069 27144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:27 dist-test-slave-cvwc krb5kdc[26977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257387, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:27.356986 27144 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:36:27.358268 27144 webserver.cc:460] Webserver started at http://127.30.78.65:43475/ using document root <none> and password file <none>
I20260809 06:36:27.358894 27144 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:27.358991 27144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:27.359241 27144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:27.361984 27144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "267bd0f170b2445893d8520ad806dcce"
format_stamp: "Formatted at 2026-08-09 06:36:27 on dist-test-slave-cvwc"
server_key: "0a21d078a5d2d112ceecf2e34108ad52"
server_key_iv: "1d821b72dcdbcf7c2b88972054c3c18b"
server_key_version: "encryptionkey@0"
I20260809 06:36:27.362674 27144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "267bd0f170b2445893d8520ad806dcce"
format_stamp: "Formatted at 2026-08-09 06:36:27 on dist-test-slave-cvwc"
server_key: "0a21d078a5d2d112ceecf2e34108ad52"
server_key_iv: "1d821b72dcdbcf7c2b88972054c3c18b"
server_key_version: "encryptionkey@0"
I20260809 06:36:27.367394 27144 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:36:27.370636 27169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:27.371776 27144 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:27.371922 27144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "267bd0f170b2445893d8520ad806dcce"
format_stamp: "Formatted at 2026-08-09 06:36:27 on dist-test-slave-cvwc"
server_key: "0a21d078a5d2d112ceecf2e34108ad52"
server_key_iv: "1d821b72dcdbcf7c2b88972054c3c18b"
server_key_version: "encryptionkey@0"
I20260809 06:36:27.372090 27144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:27.399371 27144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:27.403272 27144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:27.403527 27144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:27.404389 27144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:27.405611 27144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:27.405687 27144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:27.405833 27144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:27.405896 27144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:27.434922 27144 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:34191
I20260809 06:36:27.434986 27340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:34191 every 8 connection(s)
I20260809 06:36:27.436139 27144 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:36:27.443702 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 27144
I20260809 06:36:27.443850 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:36:27.444263 31033 external_mini_cluster.cc:1428] Setting key 200bfa528ff8fb38e4c6d8c96b228778
Aug 09 06:36:27 dist-test-slave-cvwc krb5kdc[26977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257387, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:27.454766 27345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:27.438600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:45807 (local address 127.30.78.126:40607)
0809 06:36:27.439008 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:27.439012 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:27.439911 (+ 899us) server_negotiation.cc:407] Connection header received
0809 06:36:27.441609 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:27.441614 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:27.441677 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:27.441800 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:27.443074 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:27.443775 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:27.445493 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:27.445998 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:27.446117 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:27.449148 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:27.449154 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:27.449158 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:27.449195 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:27.452022 (+ 2827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:27.452641 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:27.452646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:27.452649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:27.452782 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:27.453155 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:27.453159 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:27.453161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:27.453470 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:27.453611 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:27.454236 (+ 625us) server_negotiation.cc:299] Negotiation successful
0809 06:36:27.454445 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":200,"threads_started":1}
I20260809 06:36:27.455444 27346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:27.439137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:40607 (local address 127.30.78.65:45807)
0809 06:36:27.439764 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:27.439800 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:27.441383 (+ 1583us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:27.441969 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:27.441976 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:27.442447 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:27.442943 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:27.442959 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:27.443946 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:27.443951 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:27.445365 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:27.445379 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:27.446205 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:27.446211 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:27.446399 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:27.446962 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:36:27.446989 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:27.448946 (+ 1957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:27.452145 (+ 3199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:27.452151 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:27.452161 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:27.452534 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:27.452883 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:27.452886 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:27.452889 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:27.453062 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:27.453570 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:27.453575 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:27.453904 (+ 329us) client_negotiation.cc:769] Sending connection context
0809 06:36:27.454118 (+ 214us) client_negotiation.cc:240] Negotiation successful
0809 06:36:27.454440 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":250,"threads_started":1}
I20260809 06:36:27.456804 27343 heartbeater.cc:347] Connected to a master server at 127.30.78.126:40607
I20260809 06:36:27.457093 27343 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:27.457878 27343 heartbeater.cc:511] Master 127.30.78.126:40607 requested a full tablet report, sending...
I20260809 06:36:27.459816 27045 ts_manager.cc:194] Registered new tserver with Master: 267bd0f170b2445893d8520ad806dcce (127.30.78.65:34191)
I20260809 06:36:27.461189 27045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:45807
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:36:27.502911 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40607
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:27.818106 27349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:27.818367 27349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:27.818523 27349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:27.825496 27349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:27.825604 27349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:27.825798 27349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:36:27.835153 27349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:27.836272 27349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:27.837529 27349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:27.850080 27359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:27.850054 27360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:27.850015 27363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:27.850739 27349 server_base.cc:1034] running on GCE node
I20260809 06:36:27.851460 27349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:27.852350 27349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:27.853559 27349 hybrid_clock.cc:648] HybridClock initialized: now 1786257387853510 us; error 34 us; skew 500 ppm
I20260809 06:36:27.853894 27349 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:27 dist-test-slave-cvwc krb5kdc[26977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257387, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:27.859738 27349 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:36:27.861145 27349 webserver.cc:460] Webserver started at http://127.30.78.66:37385/ using document root <none> and password file <none>
I20260809 06:36:27.861842 27349 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:27.861967 27349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:27.862265 27349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:27.865141 27349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "90ed373550f144c3a5faf5ffda199967"
format_stamp: "Formatted at 2026-08-09 06:36:27 on dist-test-slave-cvwc"
server_key: "371bf320fef6f14c07f38dfc58fa7686"
server_key_iv: "bd51a19e37a7165dae17d34ce17ff474"
server_key_version: "encryptionkey@0"
I20260809 06:36:27.865952 27349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "90ed373550f144c3a5faf5ffda199967"
format_stamp: "Formatted at 2026-08-09 06:36:27 on dist-test-slave-cvwc"
server_key: "371bf320fef6f14c07f38dfc58fa7686"
server_key_iv: "bd51a19e37a7165dae17d34ce17ff474"
server_key_version: "encryptionkey@0"
I20260809 06:36:27.870944 27349 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:36:27.874310 27373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:27.875564 27349 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:36:27.875708 27349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "90ed373550f144c3a5faf5ffda199967"
format_stamp: "Formatted at 2026-08-09 06:36:27 on dist-test-slave-cvwc"
server_key: "371bf320fef6f14c07f38dfc58fa7686"
server_key_iv: "bd51a19e37a7165dae17d34ce17ff474"
server_key_version: "encryptionkey@0"
I20260809 06:36:27.875895 27349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:27.916142 27349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:27.920271 27349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:27.920526 27349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:27.921419 27349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:27.922751 27349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:27.922822 27349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:27.922912 27349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:27.922955 27349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:27.953081 27349 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:37761
I20260809 06:36:27.953132 27548 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:37761 every 8 connection(s)
I20260809 06:36:27.954406 27349 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:36:27.955046 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 27349
I20260809 06:36:27.955238 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:36:27.955842 31033 external_mini_cluster.cc:1428] Setting key 1d31d90ad4dcdb662dd9a7d672d05cac
Aug 09 06:36:27 dist-test-slave-cvwc krb5kdc[26977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257387, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:27.974185 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:27.957297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:43991 (local address 127.30.78.126:40607)
0809 06:36:27.957778 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:27.957783 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:27.958843 (+ 1060us) server_negotiation.cc:407] Connection header received
0809 06:36:27.960693 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:27.960698 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:27.960771 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:27.960872 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:27.962324 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:27.963239 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:27.964677 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:27.965277 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:27.965399 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:27.968496 (+ 3097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:27.968502 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:27.968506 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:27.968542 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:27.971187 (+ 2645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:27.971972 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:27.971975 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:27.971978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:27.972097 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:27.972533 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:27.972536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:27.972538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:27.972783 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:27.972913 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:27.973692 (+ 779us) server_negotiation.cc:299] Negotiation successful
0809 06:36:27.973919 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":226,"threads_started":1}
I20260809 06:36:27.975422 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:27.957906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:40607 (local address 127.30.78.66:43991)
0809 06:36:27.958670 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:27.958728 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:27.960444 (+ 1716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:27.961059 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:27.961066 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:27.961566 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:27.962164 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:27.962183 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:27.963350 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:27.963354 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:27.964538 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:27.964550 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:27.965459 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:27.965463 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:27.965643 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:27.966261 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:36:27.966281 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:27.968272 (+ 1991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:27.971319 (+ 3047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:27.971327 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:27.971341 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:27.971868 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:27.972205 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:27.972209 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:27.972213 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:27.972446 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:27.972914 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:27.972922 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:27.973336 (+ 414us) client_negotiation.cc:769] Sending connection context
0809 06:36:27.973615 (+ 279us) client_negotiation.cc:240] Negotiation successful
0809 06:36:27.974102 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":312,"threads_started":1}
I20260809 06:36:27.976842 27550 heartbeater.cc:347] Connected to a master server at 127.30.78.126:40607
I20260809 06:36:27.977159 27550 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:27.978013 27550 heartbeater.cc:511] Master 127.30.78.126:40607 requested a full tablet report, sending...
I20260809 06:36:27.979601 27045 ts_manager.cc:194] Registered new tserver with Master: 90ed373550f144c3a5faf5ffda199967 (127.30.78.66:37761)
I20260809 06:36:27.980460 27045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:43991
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:36:28.015995 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40607
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:28.337271 27556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:28.337523 27556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:28.337656 27556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:28.344858 27556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:28.344962 27556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:28.345112 27556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:36:28.354254 27556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:40607
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:28.355373 27556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:28.356633 27556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:28.368602 27564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:28.368631 27565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:28.369012 27570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:28.369663 27556 server_base.cc:1034] running on GCE node
I20260809 06:36:28.370290 27556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:28.371167 27556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:28.372363 27556 hybrid_clock.cc:648] HybridClock initialized: now 1786257388372315 us; error 37 us; skew 500 ppm
I20260809 06:36:28.372692 27556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:28 dist-test-slave-cvwc krb5kdc[26977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257388, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:28.375823 27556 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:36:28.377199 27556 webserver.cc:460] Webserver started at http://127.30.78.67:44935/ using document root <none> and password file <none>
I20260809 06:36:28.377882 27556 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:28.378000 27556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:28.378301 27556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:28.381199 27556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "d7369ca7a91044769c3c4f6709f99591"
format_stamp: "Formatted at 2026-08-09 06:36:28 on dist-test-slave-cvwc"
server_key: "d4586c932df289d958c0497f4092050f"
server_key_iv: "ae3718b86f258fbd38e85a51ac5b8ffd"
server_key_version: "encryptionkey@0"
I20260809 06:36:28.382040 27556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "d7369ca7a91044769c3c4f6709f99591"
format_stamp: "Formatted at 2026-08-09 06:36:28 on dist-test-slave-cvwc"
server_key: "d4586c932df289d958c0497f4092050f"
server_key_iv: "ae3718b86f258fbd38e85a51ac5b8ffd"
server_key_version: "encryptionkey@0"
I20260809 06:36:28.387038 27556 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:36:28.390241 27582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:28.391458 27556 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:36:28.391605 27556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "d7369ca7a91044769c3c4f6709f99591"
format_stamp: "Formatted at 2026-08-09 06:36:28 on dist-test-slave-cvwc"
server_key: "d4586c932df289d958c0497f4092050f"
server_key_iv: "ae3718b86f258fbd38e85a51ac5b8ffd"
server_key_version: "encryptionkey@0"
I20260809 06:36:28.391804 27556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:28.405850 27556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:28.409624 27556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:28.409901 27556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:28.410743 27556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:28.411978 27556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:28.412055 27556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:28.412171 27556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:28.412230 27556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:28.441617 27556 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:41509
I20260809 06:36:28.441674 27770 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:41509 every 8 connection(s)
I20260809 06:36:28.442785 27556 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:36:28.447276 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 27556
I20260809 06:36:28.447444 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:36:28.447871 31033 external_mini_cluster.cc:1428] Setting key fe7246b907d8a3f372ea63556ab82f25
Aug 09 06:36:28 dist-test-slave-cvwc krb5kdc[26977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257388, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:28.460420 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.445055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:39113 (local address 127.30.78.126:40607)
0809 06:36:28.445271 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.445277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.446336 (+ 1059us) server_negotiation.cc:407] Connection header received
0809 06:36:28.448128 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.448134 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.448212 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.448302 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:28.449849 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.450674 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.452179 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.452564 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.452653 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.455699 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:28.455704 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:28.455707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:28.455739 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:28.458110 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:28.458733 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:28.458737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:28.458739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:28.458847 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:28.459168 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:28.459171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:28.459173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:28.459422 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:28.459537 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.460046 (+ 509us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.460206 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:36:28.461406 27775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.445486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:40607 (local address 127.30.78.67:39113)
0809 06:36:28.446176 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:28.446218 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:28.447864 (+ 1646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:28.448533 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:28.448540 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:28.449113 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:28.449672 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.449697 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.450817 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.450821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.452049 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.452061 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.452722 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.452727 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.452908 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.453466 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:36:28.453488 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:28.455515 (+ 2027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:28.458235 (+ 2720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:28.458240 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:28.458249 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:28.458645 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:28.458928 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:28.458930 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:28.458933 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:28.459092 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:28.459509 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:28.459514 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:28.459772 (+ 258us) client_negotiation.cc:769] Sending connection context
0809 06:36:28.459969 (+ 197us) client_negotiation.cc:240] Negotiation successful
0809 06:36:28.460281 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":294,"threads_started":1}
I20260809 06:36:28.462728 27771 heartbeater.cc:347] Connected to a master server at 127.30.78.126:40607
I20260809 06:36:28.463001 27771 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:28.463647 27771 heartbeater.cc:511] Master 127.30.78.126:40607 requested a full tablet report, sending...
I20260809 06:36:28.463766 27343 heartbeater.cc:503] Master 127.30.78.126:40607 was elected leader, sending a full tablet report...
I20260809 06:36:28.465077 27042 ts_manager.cc:194] Registered new tserver with Master: d7369ca7a91044769c3c4f6709f99591 (127.30.78.67:41509)
I20260809 06:36:28.465945 27042 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:39113
I20260809 06:36:28.474452 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:36:28.491216 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.478534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58790 (local address 127.30.78.126:40607)
0809 06:36:28.478680 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.478684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.479156 (+ 472us) server_negotiation.cc:407] Connection header received
0809 06:36:28.479317 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.479320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.479380 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.479457 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:28.480883 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.481576 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.482808 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.483190 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.483275 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.486004 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:28.486009 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:28.486013 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:28.486046 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:28.488825 (+ 2779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:28.489476 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:28.489479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:28.489481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:28.489623 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:28.490008 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:28.490012 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:28.490014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:28.490310 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:28.490535 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.490816 (+ 281us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.490955 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 06:36:28.494844 27042 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58790:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:36:28.501415 27042 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:36:28.523016 27794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.512282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:41509 (local address 127.0.0.1:42386)
0809 06:36:28.513043 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:28.513096 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:28.513265 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:28.514670 (+ 1405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:28.514675 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:28.514700 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:28.515074 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.515083 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.517178 (+ 2095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.517185 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.519751 (+ 2566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.519768 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.522010 (+ 2242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.522017 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.522231 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.522281 (+ 50us) client_negotiation.cc:769] Sending connection context
0809 06:36:28.522417 (+ 136us) client_negotiation.cc:240] Negotiation successful
0809 06:36:28.522620 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":350,"threads_started":1}
I20260809 06:36:28.524049 27795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.512374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42386 (local address 127.30.78.67:41509)
0809 06:36:28.514053 (+ 1679us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.514062 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.514097 (+ 35us) server_negotiation.cc:407] Connection header received
0809 06:36:28.514199 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.514207 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.514448 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.514639 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:28.515273 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.516991 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.519969 (+ 2978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.521462 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.521590 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.521851 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.523508 (+ 1657us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.523697 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1496,"thread_start_us":1317,"threads_started":1}
I20260809 06:36:28.527218 27796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.513359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34191 (local address 127.0.0.1:40830)
0809 06:36:28.515288 (+ 1929us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:28.515304 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:28.516615 (+ 1311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:28.517490 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:28.517495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:28.517522 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:28.518029 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.518042 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.521440 (+ 3398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.521446 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.524839 (+ 3393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.524855 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.526488 (+ 1633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.526494 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.526666 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.526697 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 06:36:28.526785 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 06:36:28.526907 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1806,"thread_start_us":1665,"threads_started":1}
I20260809 06:36:28.527340 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.513847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40830 (local address 127.30.78.65:34191)
0809 06:36:28.514436 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.514442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.516494 (+ 2052us) server_negotiation.cc:407] Connection header received
0809 06:36:28.516806 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.516814 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.517074 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.517248 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:28.518224 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.521264 (+ 3040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.525005 (+ 3741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.526224 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.526414 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.526627 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.526857 (+ 230us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.527028 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":294,"threads_started":1}
I20260809 06:36:28.530068 27655 tablet_service.cc:1467] Processing CreateTablet for tablet 4fe48e4c09964d19b468b208a99a1988 (DEFAULT_TABLE table=test-table [id=e499258981c842cab1339d70d520899e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:28.530669 27242 tablet_service.cc:1467] Processing CreateTablet for tablet 4fe48e4c09964d19b468b208a99a1988 (DEFAULT_TABLE table=test-table [id=e499258981c842cab1339d70d520899e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:28.531661 27655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fe48e4c09964d19b468b208a99a1988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:28.531944 27242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fe48e4c09964d19b468b208a99a1988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:28.532187 27794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.515353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:37761 (local address 127.0.0.1:47898)
0809 06:36:28.523232 (+ 7879us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:28.523247 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:28.523339 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:28.526292 (+ 2953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:28.526297 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:28.526322 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:28.526492 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.526502 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.528039 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.528044 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.529822 (+ 1778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.529838 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.531529 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.531535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.531701 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.531732 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 06:36:28.531820 (+ 88us) client_negotiation.cc:240] Negotiation successful
0809 06:36:28.531949 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7780,"thread_start_us":10556,"threads_started":1}
I20260809 06:36:28.532588 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.515620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47898 (local address 127.30.78.66:37761)
0809 06:36:28.525460 (+ 9840us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.525469 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.525497 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:36:28.525594 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.525602 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.525859 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.526038 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:28.526663 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.527904 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.529989 (+ 2085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.531354 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.531494 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.531672 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.531888 (+ 216us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.532125 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9658,"thread_start_us":9508,"threads_started":1}
I20260809 06:36:28.535998 27451 tablet_service.cc:1467] Processing CreateTablet for tablet 4fe48e4c09964d19b468b208a99a1988 (DEFAULT_TABLE table=test-table [id=e499258981c842cab1339d70d520899e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:28.537273 27451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fe48e4c09964d19b468b208a99a1988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:28.543159 27803 tablet_bootstrap.cc:492] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: Bootstrap starting.
I20260809 06:36:28.546205 27803 tablet_bootstrap.cc:654] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:28.546452 27805 tablet_bootstrap.cc:492] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: Bootstrap starting.
I20260809 06:36:28.547595 27803 log.cc:824] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:28.549515 27805 tablet_bootstrap.cc:654] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:28.550321 27808 tablet_bootstrap.cc:492] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: Bootstrap starting.
I20260809 06:36:28.550756 27805 log.cc:824] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:28.551745 27803 tablet_bootstrap.cc:492] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: No bootstrap required, opened a new log
I20260809 06:36:28.551972 27803 ts_tablet_manager.cc:1397] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 06:36:28.553388 27808 tablet_bootstrap.cc:654] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:28.553857 27805 tablet_bootstrap.cc:492] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: No bootstrap required, opened a new log
I20260809 06:36:28.554104 27805 ts_tablet_manager.cc:1397] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 06:36:28.554359 27808 log.cc:824] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:28.556525 27808 tablet_bootstrap.cc:492] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: No bootstrap required, opened a new log
I20260809 06:36:28.556735 27808 ts_tablet_manager.cc:1397] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s
I20260809 06:36:28.562196 27803 raft_consensus.cc:348] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } }
I20260809 06:36:28.562628 27803 raft_consensus.cc:374] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:28.562726 27803 raft_consensus.cc:729] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 267bd0f170b2445893d8520ad806dcce, State: Initialized, Role: FOLLOWER
I20260809 06:36:28.563330 27803 consensus_queue.cc:260] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } }
I20260809 06:36:28.564126 27808 raft_consensus.cc:348] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } }
I20260809 06:36:28.564431 27808 raft_consensus.cc:374] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:28.564141 27805 raft_consensus.cc:348] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } }
I20260809 06:36:28.564520 27808 raft_consensus.cc:729] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90ed373550f144c3a5faf5ffda199967, State: Initialized, Role: FOLLOWER
I20260809 06:36:28.564561 27805 raft_consensus.cc:374] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:28.564653 27805 raft_consensus.cc:729] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7369ca7a91044769c3c4f6709f99591, State: Initialized, Role: FOLLOWER
I20260809 06:36:28.565136 27808 consensus_queue.cc:260] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } }
I20260809 06:36:28.565253 27805 consensus_queue.cc:260] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } }
I20260809 06:36:28.566402 27771 heartbeater.cc:503] Master 127.30.78.126:40607 was elected leader, sending a full tablet report...
I20260809 06:36:28.567044 27805 ts_tablet_manager.cc:1428] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260809 06:36:28.568486 27803 ts_tablet_manager.cc:1428] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: Time spent starting tablet: real 0.016s user 0.016s sys 0.000s
I20260809 06:36:28.569422 27550 heartbeater.cc:503] Master 127.30.78.126:40607 was elected leader, sending a full tablet report...
I20260809 06:36:28.570034 27808 ts_tablet_manager.cc:1428] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: Time spent starting tablet: real 0.013s user 0.001s sys 0.013s
W20260809 06:36:28.688527 27344 tablet.cc:2369] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:36:28.688908 27811 raft_consensus.cc:482] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:36:28.689200 27811 raft_consensus.cc:504] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } }
I20260809 06:36:28.690912 27811 leader_election.cc:288] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7369ca7a91044769c3c4f6709f99591 (127.30.78.67:41509), 90ed373550f144c3a5faf5ffda199967 (127.30.78.66:37761)
W20260809 06:36:28.694221 27773 tablet.cc:2369] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:36:28.697625 27814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.691171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:41509 (local address 127.30.78.65:38487)
0809 06:36:28.691770 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:28.691790 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:28.691945 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:28.692368 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:28.692372 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:28.692400 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:28.692704 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.692713 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.693690 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.693694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.695668 (+ 1974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.695683 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.697034 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.697039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.697154 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.697178 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:36:28.697252 (+ 74us) client_negotiation.cc:240] Negotiation successful
0809 06:36:28.697337 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":289,"threads_started":1}
I20260809 06:36:28.697672 27795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.691296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:38487 (local address 127.30.78.67:41509)
0809 06:36:28.691471 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.691475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.691863 (+ 388us) server_negotiation.cc:407] Connection header received
0809 06:36:28.692132 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.692138 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.692216 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.692306 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:28.692839 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.693565 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.695806 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.696857 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.697013 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.697087 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.697299 (+ 212us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.697434 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 06:36:28.698412 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.692028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:54657 (local address 127.30.78.66:37761)
0809 06:36:28.692218 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.692223 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.692577 (+ 354us) server_negotiation.cc:407] Connection header received
0809 06:36:28.692743 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.692747 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.692804 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.692876 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:28.693395 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.694198 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.696321 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.697436 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.697579 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.697641 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.698054 (+ 413us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.698180 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260809 06:36:28.698508 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.691892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:37761 (local address 127.30.78.65:54657)
0809 06:36:28.692476 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:28.692489 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:28.692613 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:28.692906 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:28.692910 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:28.692933 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:28.693241 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.693249 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.694344 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.694350 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.696200 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:28.696211 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.697654 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.697660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:28.697846 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.697876 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:36:28.698001 (+ 125us) client_negotiation.cc:240] Negotiation successful
0809 06:36:28.698119 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"mutex_wait_us":3,"thread_start_us":303,"threads_started":1}
I20260809 06:36:28.698729 27689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fe48e4c09964d19b468b208a99a1988" candidate_uuid: "267bd0f170b2445893d8520ad806dcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7369ca7a91044769c3c4f6709f99591" is_pre_election: true
I20260809 06:36:28.699295 27689 raft_consensus.cc:2454] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 267bd0f170b2445893d8520ad806dcce in term 0.
I20260809 06:36:28.699432 27481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fe48e4c09964d19b468b208a99a1988" candidate_uuid: "267bd0f170b2445893d8520ad806dcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ed373550f144c3a5faf5ffda199967" is_pre_election: true
I20260809 06:36:28.699919 27481 raft_consensus.cc:2454] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 267bd0f170b2445893d8520ad806dcce in term 0.
I20260809 06:36:28.699961 27173 leader_election.cc:302] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 267bd0f170b2445893d8520ad806dcce, d7369ca7a91044769c3c4f6709f99591; no voters:
I20260809 06:36:28.700317 27811 raft_consensus.cc:2781] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:36:28.700440 27811 raft_consensus.cc:482] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:36:28.700544 27811 raft_consensus.cc:3037] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:28.702687 27811 raft_consensus.cc:504] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } }
I20260809 06:36:28.703224 27811 leader_election.cc:288] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [CANDIDATE]: Term 1 election: Requested vote from peers d7369ca7a91044769c3c4f6709f99591 (127.30.78.67:41509), 90ed373550f144c3a5faf5ffda199967 (127.30.78.66:37761)
I20260809 06:36:28.703620 27689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fe48e4c09964d19b468b208a99a1988" candidate_uuid: "267bd0f170b2445893d8520ad806dcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7369ca7a91044769c3c4f6709f99591"
I20260809 06:36:28.703682 27481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fe48e4c09964d19b468b208a99a1988" candidate_uuid: "267bd0f170b2445893d8520ad806dcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90ed373550f144c3a5faf5ffda199967"
I20260809 06:36:28.703786 27689 raft_consensus.cc:3037] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:28.703857 27481 raft_consensus.cc:3037] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:28.705924 27689 raft_consensus.cc:2454] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 267bd0f170b2445893d8520ad806dcce in term 1.
I20260809 06:36:28.706055 27481 raft_consensus.cc:2454] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 267bd0f170b2445893d8520ad806dcce in term 1.
I20260809 06:36:28.706259 27173 leader_election.cc:302] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 267bd0f170b2445893d8520ad806dcce, d7369ca7a91044769c3c4f6709f99591; no voters:
I20260809 06:36:28.706528 27811 raft_consensus.cc:2781] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:28.706933 27811 raft_consensus.cc:686] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 1 LEADER]: Becoming Leader. State: Replica: 267bd0f170b2445893d8520ad806dcce, State: Running, Role: LEADER
W20260809 06:36:28.707386 27551 tablet.cc:2369] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:36:28.707614 27811 consensus_queue.cc:237] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } }
I20260809 06:36:28.711790 27038 catalog_manager.cc:5495] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 267bd0f170b2445893d8520ad806dcce (127.30.78.65). New cstate: current_term: 1 leader_uuid: "267bd0f170b2445893d8520ad806dcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "267bd0f170b2445893d8520ad806dcce" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 } health_report { overall_health: UNKNOWN } } }
I20260809 06:36:28.755646 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.750893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40840 (local address 127.30.78.65:34191)
0809 06:36:28.751052 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.751057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.751136 (+ 79us) server_negotiation.cc:407] Connection header received
0809 06:36:28.751289 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.751293 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.751366 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.751488 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:36:28.751845 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.752564 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.753898 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.754303 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.754401 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.754758 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:36:28.755216 (+ 458us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:36:28.755342 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.755422 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.755458 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 06:36:28.763375 27689 raft_consensus.cc:1261] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [term 1 FOLLOWER]: Refusing update from remote peer 267bd0f170b2445893d8520ad806dcce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:28.763387 27481 raft_consensus.cc:1261] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [term 1 FOLLOWER]: Refusing update from remote peer 267bd0f170b2445893d8520ad806dcce: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:28.764346 27817 consensus_queue.cc:1035] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7369ca7a91044769c3c4f6709f99591" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 41509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:28.764674 27811 consensus_queue.cc:1035] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "90ed373550f144c3a5faf5ffda199967" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 37761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:28.775563 27822 mvcc.cc:205] Tried to move back new op lower bound from 7316510264364371968 to 7316510264149692416. Current Snapshot: MvccSnapshot[applied={T|T < 7316510264364371968}]
I20260809 06:36:28.788174 27038 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:28.788415 27038 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:28.791802 27038 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 926125d8b95c4502a32778903a8b9d5e: Sending DeleteTablet for 3 replicas of tablet 4fe48e4c09964d19b468b208a99a1988
I20260809 06:36:28.792759 27655 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fe48e4c09964d19b468b208a99a1988 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:28 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:42386
I20260809 06:36:28.792917 27242 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fe48e4c09964d19b468b208a99a1988 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:28 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:40830
I20260809 06:36:28.792940 27451 tablet_service.cc:1514] Processing DeleteTablet for tablet 4fe48e4c09964d19b468b208a99a1988 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:28 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:47898
I20260809 06:36:28.795854 27841 tablet_replica.cc:330] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: stopping tablet replica
I20260809 06:36:28.796238 27841 raft_consensus.cc:2229] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:28.796520 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 27144
I20260809 06:36:28.796681 27841 raft_consensus.cc:2258] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:28.803118 27841 ts_tablet_manager.cc:1905] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:28.807852 27840 tablet_replica.cc:330] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: stopping tablet replica
I20260809 06:36:28.808239 27840 raft_consensus.cc:2229] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:36:28.808832 27840 raft_consensus.cc:2258] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:28.809866 27838 tablet_replica.cc:330] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: stopping tablet replica
I20260809 06:36:28.810189 27841 ts_tablet_manager.cc:1918] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:28.810259 27838 raft_consensus.cc:2229] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:28.810357 27841 log.cc:1196] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/4fe48e4c09964d19b468b208a99a1988
I20260809 06:36:28.810750 27838 raft_consensus.cc:2258] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:28.810890 27841 ts_tablet_manager.cc:1939] T 4fe48e4c09964d19b468b208a99a1988 P 90ed373550f144c3a5faf5ffda199967: Deleting consensus metadata
I20260809 06:36:28.812350 27840 ts_tablet_manager.cc:1905] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:28.812790 27024 catalog_manager.cc:4841] TS 90ed373550f144c3a5faf5ffda199967 (127.30.78.66:37761): tablet 4fe48e4c09964d19b468b208a99a1988 (table test-table [id=e499258981c842cab1339d70d520899e]) successfully deleted
I20260809 06:36:28.814522 27838 ts_tablet_manager.cc:1905] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 09 06:36:28 dist-test-slave-cvwc krb5kdc[26977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:36:28.819579 27840 ts_tablet_manager.cc:1918] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:28.819733 27840 log.cc:1196] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/4fe48e4c09964d19b468b208a99a1988
I20260809 06:36:28.820281 27840 ts_tablet_manager.cc:1939] T 4fe48e4c09964d19b468b208a99a1988 P 267bd0f170b2445893d8520ad806dcce: Deleting consensus metadata
I20260809 06:36:28.820916 27838 ts_tablet_manager.cc:1918] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:28.821051 27838 log.cc:1196] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/4fe48e4c09964d19b468b208a99a1988
I20260809 06:36:28.821595 27838 ts_tablet_manager.cc:1939] T 4fe48e4c09964d19b468b208a99a1988 P d7369ca7a91044769c3c4f6709f99591: Deleting consensus metadata
I20260809 06:36:28.821949 27024 catalog_manager.cc:4841] TS 267bd0f170b2445893d8520ad806dcce (127.30.78.65:34191): tablet 4fe48e4c09964d19b468b208a99a1988 (table test-table [id=e499258981c842cab1339d70d520899e]) successfully deleted
I20260809 06:36:28.824908 27797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.797433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40856 (local address 127.30.78.65:34191)
0809 06:36:28.797612 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.797618 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.801516 (+ 3898us) server_negotiation.cc:407] Connection header received
0809 06:36:28.802328 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.802334 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.802409 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.802479 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:28.805921 (+ 3442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.807172 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.810512 (+ 3340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.811176 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.811278 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.817442 (+ 6164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:28.817456 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:28.817477 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:28.817520 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:28.821693 (+ 4173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:28.822674 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:28.822682 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:28.822685 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:28.822891 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:28.823406 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:28.823409 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:28.823411 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:28.823737 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:28.824023 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.824351 (+ 328us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.824579 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 06:36:28.825476 27333 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:28.826045 27024 catalog_manager.cc:4841] TS d7369ca7a91044769c3c4f6709f99591 (127.30.78.67:41509): tablet 4fe48e4c09964d19b468b208a99a1988 (table test-table [id=e499258981c842cab1339d70d520899e]) successfully deleted
I20260809 06:36:28.924358 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 27144
I20260809 06:36:28.944721 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 27349
Aug 09 06:36:28 dist-test-slave-cvwc krb5kdc[26977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:36:28.959843 27802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:28.945497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47908 (local address 127.30.78.66:37761)
0809 06:36:28.945681 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:28.945687 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:28.945706 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:36:28.945893 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:28.945897 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:28.945969 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:28.946052 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:28.947293 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.948057 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.949316 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:28.949860 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:28.949978 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:28.954230 (+ 4252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:28.954241 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:28.954253 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:28.954286 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:28.957097 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:28.957791 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:28.957798 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:28.957801 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:28.957943 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:28.958311 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:28.958315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:28.958317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:28.958735 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:28.959025 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:28.959308 (+ 283us) server_negotiation.cc:299] Negotiation successful
0809 06:36:28.959530 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:36:28.960484 27544 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:29.048385 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 27349
I20260809 06:36:29.069778 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 27556
Aug 09 06:36:29 dist-test-slave-cvwc krb5kdc[26977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257386, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:36:29.083801 27795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:29.070541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42390 (local address 127.30.78.67:41509)
0809 06:36:29.070743 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:29.070749 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:29.070771 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:36:29.070912 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:29.070916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:29.070990 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:29.071073 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:29.072276 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:29.073016 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:29.074497 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:29.074858 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:29.074957 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:29.079047 (+ 4090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:29.079063 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:29.079079 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:29.079111 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:29.081497 (+ 2386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:29.082183 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:29.082190 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:29.082193 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:29.082317 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:29.082588 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:29.082590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:29.082592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:29.082950 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:29.083164 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:29.083347 (+ 183us) server_negotiation.cc:299] Negotiation successful
0809 06:36:29.083499 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:36:29.084408 27762 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:29.170589 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 27556
I20260809 06:36:29.195464 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 26999
I20260809 06:36:29.196514 27089 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:29.304667 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 26999
2026-08-09T06:36:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4365 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-09T06:36:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:29Z Disabled control of system clock
I20260809 06:36:29.386543 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:39997
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:39997
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:36:29.714669 27857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:29.714948 27857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:29.715046 27857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:29.722177 27857 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:29.722286 27857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:29.722337 27857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:29.722399 27857 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:29.722450 27857 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:29.731689 27857 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:39997
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:39997
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:29.732867 27857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:29.734654 27857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:29.746089 27864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:29.746254 27865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:29.746483 27870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:29.747225 27857 server_base.cc:1034] running on GCE node
I20260809 06:36:29.747934 27857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:29.749217 27857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:29.750415 27857 hybrid_clock.cc:648] HybridClock initialized: now 1786257389750371 us; error 39 us; skew 500 ppm
I20260809 06:36:29.750725 27857 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:29.752803 27857 webserver.cc:460] Webserver started at http://127.30.78.126:37837/ using document root <none> and password file <none>
I20260809 06:36:29.753484 27857 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:29.753585 27857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:29.753913 27857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:29.756677 27857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "b029099af47f49c9b857188b7c7f83b3"
format_stamp: "Formatted at 2026-08-09 06:36:29 on dist-test-slave-cvwc"
server_key: "4ff26e93ffce9be0f44879bd0fd91757"
server_key_iv: "fc1002b805dfbfe777c3ecf641fefb48"
server_key_version: "encryptionkey@0"
I20260809 06:36:29.757458 27857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "b029099af47f49c9b857188b7c7f83b3"
format_stamp: "Formatted at 2026-08-09 06:36:29 on dist-test-slave-cvwc"
server_key: "4ff26e93ffce9be0f44879bd0fd91757"
server_key_iv: "fc1002b805dfbfe777c3ecf641fefb48"
server_key_version: "encryptionkey@0"
I20260809 06:36:29.762151 27857 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:36:29.765268 27878 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:29.766485 27857 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:29.766644 27857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "b029099af47f49c9b857188b7c7f83b3"
format_stamp: "Formatted at 2026-08-09 06:36:29 on dist-test-slave-cvwc"
server_key: "4ff26e93ffce9be0f44879bd0fd91757"
server_key_iv: "fc1002b805dfbfe777c3ecf641fefb48"
server_key_version: "encryptionkey@0"
I20260809 06:36:29.766839 27857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:29.777784 27857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:29.778501 27857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:29.778744 27857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:29.794958 27857 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:39997
I20260809 06:36:29.794991 27955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:39997 every 8 connection(s)
I20260809 06:36:29.796120 27857 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:29.797967 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 27857
I20260809 06:36:29.798121 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:29.798616 31033 external_mini_cluster.cc:1428] Setting key 65d844b9d5e4b1cade62539725f33d7d
I20260809 06:36:29.799988 27957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:29.812672 27960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:29.800347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49256 (local address 127.30.78.126:39997)
0809 06:36:29.801395 (+ 1048us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:29.801410 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:29.801460 (+ 50us) server_negotiation.cc:407] Connection header received
0809 06:36:29.803170 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:29.803197 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:29.803751 (+ 554us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:29.804178 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:29.804688 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:29.806653 (+ 1965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:29.807899 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:29.808854 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:29.809037 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:29.810059 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:29.810070 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:29.810090 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:29.810773 (+ 683us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:29.810867 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:29.810914 (+ 47us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:29.811030 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:29.811166 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 06:36:29.811480 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":324,"threads_started":1}
I20260809 06:36:29.814072 27957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3: Bootstrap starting.
I20260809 06:36:29.816946 27957 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:29.818001 27957 log.cc:824] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:29.820425 27957 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3: No bootstrap required, opened a new log
I20260809 06:36:29.828004 27957 raft_consensus.cc:348] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b029099af47f49c9b857188b7c7f83b3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39997 } }
I20260809 06:36:29.828341 27957 raft_consensus.cc:374] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:29.828444 27957 raft_consensus.cc:729] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b029099af47f49c9b857188b7c7f83b3, State: Initialized, Role: FOLLOWER
I20260809 06:36:29.828989 27957 consensus_queue.cc:260] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b029099af47f49c9b857188b7c7f83b3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39997 } }
I20260809 06:36:29.829213 27957 raft_consensus.cc:388] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:29.829355 27957 raft_consensus.cc:482] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:29.829532 27957 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:29.831957 27957 raft_consensus.cc:504] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b029099af47f49c9b857188b7c7f83b3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39997 } }
I20260809 06:36:29.832461 27957 leader_election.cc:302] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b029099af47f49c9b857188b7c7f83b3; no voters:
I20260809 06:36:29.833000 27957 leader_election.cc:288] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:29.833110 27962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:29.833756 27962 raft_consensus.cc:686] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [term 1 LEADER]: Becoming Leader. State: Replica: b029099af47f49c9b857188b7c7f83b3, State: Running, Role: LEADER
I20260809 06:36:29.834254 27962 consensus_queue.cc:237] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b029099af47f49c9b857188b7c7f83b3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39997 } }
I20260809 06:36:29.834995 27957 sys_catalog.cc:564] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:29.837195 27964 sys_catalog.cc:455] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b029099af47f49c9b857188b7c7f83b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b029099af47f49c9b857188b7c7f83b3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39997 } } }
I20260809 06:36:29.837850 27964 sys_catalog.cc:458] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:29.837183 27967 sys_catalog.cc:455] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b029099af47f49c9b857188b7c7f83b3. Latest consensus state: current_term: 1 leader_uuid: "b029099af47f49c9b857188b7c7f83b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b029099af47f49c9b857188b7c7f83b3" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 39997 } } }
I20260809 06:36:29.839005 27967 sys_catalog.cc:458] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:29.840225 27979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:29.844755 27979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:29.853611 27979 catalog_manager.cc:1347] Generated new cluster ID: 701cf98a84f84aa5bdbcb3b4bc89d2b2
I20260809 06:36:29.853739 27979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:29.892969 27979 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:29.894488 27979 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:29.903412 27979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3: Generated new TSK 0
I20260809 06:36:29.904181 27979 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:29.908103 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39997
--builtin_ntp_servers=127.30.78.84:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:36:30.251034 27992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:30.251276 27992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:30.251381 27992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:30.258508 27992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:30.258594 27992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:30.258719 27992 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:36:30.267401 27992 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:30.268623 27992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:30.270475 27992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:30.282590 27999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:30.282635 28001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:30.282675 28006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:30.283568 27992 server_base.cc:1034] running on GCE node
I20260809 06:36:30.284173 27992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:30.285075 27992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:30.286271 27992 hybrid_clock.cc:648] HybridClock initialized: now 1786257390286223 us; error 34 us; skew 500 ppm
I20260809 06:36:30.286561 27992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:30.288617 27992 webserver.cc:460] Webserver started at http://127.30.78.65:35109/ using document root <none> and password file <none>
I20260809 06:36:30.289279 27992 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:30.289378 27992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:30.289673 27992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:30.292374 27992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "7c39e1a955a742ddbf6d354ddc188758"
format_stamp: "Formatted at 2026-08-09 06:36:30 on dist-test-slave-cvwc"
server_key: "1ddb2168ce63ac0037a3d6faf54fa356"
server_key_iv: "36d9b1f1b37c06f8b154924cad6c3213"
server_key_version: "encryptionkey@0"
I20260809 06:36:30.293113 27992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "7c39e1a955a742ddbf6d354ddc188758"
format_stamp: "Formatted at 2026-08-09 06:36:30 on dist-test-slave-cvwc"
server_key: "1ddb2168ce63ac0037a3d6faf54fa356"
server_key_iv: "36d9b1f1b37c06f8b154924cad6c3213"
server_key_version: "encryptionkey@0"
I20260809 06:36:30.297821 27992 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:36:30.300918 28014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:30.302127 27992 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:30.302270 27992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "7c39e1a955a742ddbf6d354ddc188758"
format_stamp: "Formatted at 2026-08-09 06:36:30 on dist-test-slave-cvwc"
server_key: "1ddb2168ce63ac0037a3d6faf54fa356"
server_key_iv: "36d9b1f1b37c06f8b154924cad6c3213"
server_key_version: "encryptionkey@0"
I20260809 06:36:30.302451 27992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:30.323159 27992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:30.323815 27992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:30.324079 27992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:30.324905 27992 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:30.326228 27992 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:30.326323 27992 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:30.326421 27992 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:30.326489 27992 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:30.355283 27992 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:34407
I20260809 06:36:30.355374 28196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:34407 every 8 connection(s)
I20260809 06:36:30.356432 27992 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:36:30.359865 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 27992
I20260809 06:36:30.360059 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:36:30.360562 31033 external_mini_cluster.cc:1428] Setting key 37f10b42e449862a1d89fcd0df65897c
I20260809 06:36:30.363076 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39997
--builtin_ntp_servers=127.30.78.84:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:36:30.368285 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:30.358710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:44493 (local address 127.30.78.126:39997)
0809 06:36:30.359113 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:30.359118 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:30.360276 (+ 1158us) server_negotiation.cc:407] Connection header received
0809 06:36:30.362087 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:30.362093 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:30.362165 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:30.362257 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:30.363265 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:30.364225 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:30.365693 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:30.366262 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:30.366383 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:30.367534 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:30.367540 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:30.367544 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:30.367564 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:30.367611 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:30.367626 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:30.367705 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:30.367884 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 06:36:30.367973 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":212,"threads_started":1}
I20260809 06:36:30.369076 28204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:30.359262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:39997 (local address 127.30.78.65:44493)
0809 06:36:30.360109 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:30.360172 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:30.361841 (+ 1669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:30.362493 (+ 652us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:30.362501 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:30.362585 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:30.363086 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:30.363102 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:30.364374 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:30.364378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:30.365553 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:30.365566 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:30.366446 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:30.366450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:30.366641 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:30.367234 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:36:30.367237 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:30.367272 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:36:30.367347 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:30.367714 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:30.367720 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:30.367725 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:36:30.367848 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 06:36:30.368112 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":261,"threads_started":1}
I20260809 06:36:30.370471 28198 heartbeater.cc:347] Connected to a master server at 127.30.78.126:39997
I20260809 06:36:30.370761 28198 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:30.371603 28198 heartbeater.cc:511] Master 127.30.78.126:39997 requested a full tablet report, sending...
I20260809 06:36:30.373574 27903 ts_manager.cc:194] Registered new tserver with Master: 7c39e1a955a742ddbf6d354ddc188758 (127.30.78.65:34407)
I20260809 06:36:30.375020 27903 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.65:44493
W20260809 06:36:30.695140 28205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:30.695399 28205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:30.695524 28205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:30.702517 28205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:30.702607 28205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:30.702747 28205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:36:30.711558 28205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:30.712736 28205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:30.714691 28205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:30.727042 28215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:30.727123 28219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:30.727000 28217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:30.727731 28205 server_base.cc:1034] running on GCE node
I20260809 06:36:30.728273 28205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:30.729121 28205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:30.730310 28205 hybrid_clock.cc:648] HybridClock initialized: now 1786257390730270 us; error 29 us; skew 500 ppm
I20260809 06:36:30.730595 28205 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:30.732623 28205 webserver.cc:460] Webserver started at http://127.30.78.66:40049/ using document root <none> and password file <none>
I20260809 06:36:30.733228 28205 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:30.733320 28205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:30.733614 28205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:30.736353 28205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "856204109e81473ea6af0c21b55ac270"
format_stamp: "Formatted at 2026-08-09 06:36:30 on dist-test-slave-cvwc"
server_key: "d75f797491dc816a1c69b422dfc8211a"
server_key_iv: "dcaba39f50a1c5e22d9d23fe7fd63041"
server_key_version: "encryptionkey@0"
I20260809 06:36:30.737111 28205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "856204109e81473ea6af0c21b55ac270"
format_stamp: "Formatted at 2026-08-09 06:36:30 on dist-test-slave-cvwc"
server_key: "d75f797491dc816a1c69b422dfc8211a"
server_key_iv: "dcaba39f50a1c5e22d9d23fe7fd63041"
server_key_version: "encryptionkey@0"
I20260809 06:36:30.741914 28205 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260809 06:36:30.744989 28233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:30.746153 28205 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:30.746299 28205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "856204109e81473ea6af0c21b55ac270"
format_stamp: "Formatted at 2026-08-09 06:36:30 on dist-test-slave-cvwc"
server_key: "d75f797491dc816a1c69b422dfc8211a"
server_key_iv: "dcaba39f50a1c5e22d9d23fe7fd63041"
server_key_version: "encryptionkey@0"
I20260809 06:36:30.746486 28205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:30.772874 28205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:30.773646 28205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:30.773934 28205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:30.774838 28205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:30.776186 28205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:30.776270 28205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:30.776353 28205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:30.776428 28205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:30.807228 28205 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:40977
I20260809 06:36:30.807288 28412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:40977 every 8 connection(s)
I20260809 06:36:30.808480 28205 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:36:30.810519 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 28205
I20260809 06:36:30.810689 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:36:30.811235 31033 external_mini_cluster.cc:1428] Setting key fd75535ebbf6ab4036439e08f5e20b30
I20260809 06:36:30.814175 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39997
--builtin_ntp_servers=127.30.78.84:43533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:36:30.821590 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:30.810940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:39187 (local address 127.30.78.126:39997)
0809 06:36:30.811142 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:30.811148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:30.812727 (+ 1579us) server_negotiation.cc:407] Connection header received
0809 06:36:30.814994 (+ 2267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:30.814998 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:30.815060 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:30.815139 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:30.816423 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:30.817120 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:30.819116 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:30.819499 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:30.819587 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:30.820950 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:30.820955 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:30.820958 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:30.820974 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:30.821015 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:30.821027 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:30.821092 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:30.821294 (+ 202us) server_negotiation.cc:299] Negotiation successful
0809 06:36:30.821371 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260809 06:36:30.822893 28417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:30.811569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:39997 (local address 127.30.78.66:39187)
0809 06:36:30.812570 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:30.812614 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:30.814712 (+ 2098us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:30.815389 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:30.815400 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:30.815510 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:30.816272 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:30.816295 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:30.817268 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:30.817273 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:30.818991 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:30.819006 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:30.819701 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:30.819708 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:30.819975 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:30.820639 (+ 664us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:36:30.820642 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:30.820693 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:36:30.820778 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:30.821110 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:30.821119 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:30.821125 (+ 6us) client_negotiation.cc:769] Sending connection context
0809 06:36:30.821294 (+ 169us) client_negotiation.cc:240] Negotiation successful
0809 06:36:30.821645 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":327,"threads_started":1}
I20260809 06:36:30.824152 28413 heartbeater.cc:347] Connected to a master server at 127.30.78.126:39997
I20260809 06:36:30.824493 28413 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:30.825376 28413 heartbeater.cc:511] Master 127.30.78.126:39997 requested a full tablet report, sending...
I20260809 06:36:30.827023 27903 ts_manager.cc:194] Registered new tserver with Master: 856204109e81473ea6af0c21b55ac270 (127.30.78.66:40977)
I20260809 06:36:30.828011 27903 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.66:39187
W20260809 06:36:31.149369 28418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:31.149616 28418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:31.149705 28418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:31.156678 28418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:31.156766 28418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:31.156869 28418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:36:31.165380 28418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:43533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:39997
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:31.166515 28418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:31.168130 28418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:31.180150 28428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:31.180209 28426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:31.180186 28425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:31.180948 28418 server_base.cc:1034] running on GCE node
I20260809 06:36:31.181529 28418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:31.182444 28418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:31.183672 28418 hybrid_clock.cc:648] HybridClock initialized: now 1786257391183619 us; error 41 us; skew 500 ppm
I20260809 06:36:31.183974 28418 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:31.186084 28418 webserver.cc:460] Webserver started at http://127.30.78.67:37699/ using document root <none> and password file <none>
I20260809 06:36:31.186708 28418 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:31.186808 28418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:31.187099 28418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:31.189795 28418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "ab03fa4978724eeca0d4292ecaf5c50a"
format_stamp: "Formatted at 2026-08-09 06:36:31 on dist-test-slave-cvwc"
server_key: "771fde721dc968dd266f792525856942"
server_key_iv: "06ad920ff921c8f9984a3083b819f051"
server_key_version: "encryptionkey@0"
I20260809 06:36:31.190555 28418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "ab03fa4978724eeca0d4292ecaf5c50a"
format_stamp: "Formatted at 2026-08-09 06:36:31 on dist-test-slave-cvwc"
server_key: "771fde721dc968dd266f792525856942"
server_key_iv: "06ad920ff921c8f9984a3083b819f051"
server_key_version: "encryptionkey@0"
I20260809 06:36:31.195216 28418 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:36:31.198354 28439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:31.199548 28418 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:31.199694 28418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "ab03fa4978724eeca0d4292ecaf5c50a"
format_stamp: "Formatted at 2026-08-09 06:36:31 on dist-test-slave-cvwc"
server_key: "771fde721dc968dd266f792525856942"
server_key_iv: "06ad920ff921c8f9984a3083b819f051"
server_key_version: "encryptionkey@0"
I20260809 06:36:31.199877 28418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:31.218746 28418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:31.219457 28418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:31.219727 28418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:31.220623 28418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:31.222007 28418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:31.222103 28418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:31.222208 28418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:31.222277 28418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:31.251363 28418 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:43409
I20260809 06:36:31.251396 28604 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:43409 every 8 connection(s)
I20260809 06:36:31.252636 28418 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:36:31.252888 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 28418
I20260809 06:36:31.253078 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:36:31.253610 31033 external_mini_cluster.cc:1428] Setting key 5d35f45837e342f70c45530f0faf4368
I20260809 06:36:31.264516 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.255330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:45959 (local address 127.30.78.126:39997)
0809 06:36:31.255550 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:31.255556 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:31.257308 (+ 1752us) server_negotiation.cc:407] Connection header received
0809 06:36:31.259040 (+ 1732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:31.259044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:31.259105 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:31.259185 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:31.260127 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.260838 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.262319 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.262714 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.262800 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.263932 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:31.263937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:31.263940 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:31.263956 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:31.263988 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:31.264000 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:31.264064 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:31.264214 (+ 150us) server_negotiation.cc:299] Negotiation successful
0809 06:36:31.264288 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:36:31.265389 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.256039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:39997 (local address 127.30.78.67:45959)
0809 06:36:31.257173 (+ 1134us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:31.257209 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:31.258819 (+ 1610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:31.259359 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:31.259366 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:31.259450 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:31.260007 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.260024 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.260953 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.260957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.262213 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.262225 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.262888 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.262893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.263077 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.263654 (+ 577us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:36:31.263656 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:31.263698 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:36:31.263770 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:31.264069 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:31.264074 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:31.264079 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:36:31.264200 (+ 121us) client_negotiation.cc:240] Negotiation successful
0809 06:36:31.264459 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":324,"threads_started":1}
I20260809 06:36:31.266556 28606 heartbeater.cc:347] Connected to a master server at 127.30.78.126:39997
I20260809 06:36:31.266826 28606 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:31.267590 28606 heartbeater.cc:511] Master 127.30.78.126:39997 requested a full tablet report, sending...
I20260809 06:36:31.269007 27902 ts_manager.cc:194] Registered new tserver with Master: ab03fa4978724eeca0d4292ecaf5c50a (127.30.78.67:43409)
I20260809 06:36:31.269870 27902 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.67:45959
I20260809 06:36:31.280856 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:36:31.290475 28203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.284769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49260 (local address 127.30.78.126:39997)
0809 06:36:31.284938 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:31.284943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:31.285295 (+ 352us) server_negotiation.cc:407] Connection header received
0809 06:36:31.285453 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:31.285457 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:31.285516 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:31.285594 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:31.286098 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.286774 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.288137 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.288562 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.288667 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.289802 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:31.289807 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:31.289811 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:31.289827 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:31.289858 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:31.289870 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:31.290002 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:31.290179 (+ 177us) server_negotiation.cc:299] Negotiation successful
0809 06:36:31.290231 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:36:31.294353 27902 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49260:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:36:31.301350 27902 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:36:31.323063 28628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.312832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:43409 (local address 127.0.0.1:45318)
0809 06:36:31.313776 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:31.313818 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:31.313989 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:31.315474 (+ 1485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:31.315480 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:31.315508 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:31.315941 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.315956 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.318072 (+ 2116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.318077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.320521 (+ 2444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.320537 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.322080 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.322087 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.322301 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.322389 (+ 88us) client_negotiation.cc:769] Sending connection context
0809 06:36:31.322512 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 06:36:31.322689 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"mutex_wait_us":93,"thread_start_us":789,"threads_started":1}
I20260809 06:36:31.323781 28630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.313181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45318 (local address 127.30.78.67:43409)
0809 06:36:31.314828 (+ 1647us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:31.314836 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:31.314876 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:36:31.314981 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:31.314989 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:31.315236 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:31.316127 (+ 891us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:31.316406 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.317925 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.320738 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.321874 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.322930 (+ 1056us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.323193 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:31.323263 (+ 70us) server_negotiation.cc:299] Negotiation successful
0809 06:36:31.323430 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1490,"thread_start_us":3435,"threads_started":1}
I20260809 06:36:31.323932 28631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.313267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34407 (local address 127.0.0.1:54328)
0809 06:36:31.314941 (+ 1674us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:31.314957 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:31.315143 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:31.316006 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:31.316011 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:31.316035 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:31.316454 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.316468 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.318341 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.318348 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.320384 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.320399 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.322492 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.322500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.322702 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.322757 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 06:36:31.322849 (+ 92us) client_negotiation.cc:240] Negotiation successful
0809 06:36:31.322969 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1540,"mutex_wait_us":31,"thread_start_us":1397,"threads_started":1}
I20260809 06:36:31.324397 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.313437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54328 (local address 127.30.78.65:34407)
0809 06:36:31.314509 (+ 1072us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:31.314517 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:31.315044 (+ 527us) server_negotiation.cc:407] Connection header received
0809 06:36:31.315327 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:31.315335 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:31.315549 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:31.315709 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:31.316655 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.318148 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.320582 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.321939 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.322090 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.322337 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:31.323181 (+ 844us) server_negotiation.cc:299] Negotiation successful
0809 06:36:31.323959 (+ 778us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":919,"thread_start_us":800,"threads_started":1}
I20260809 06:36:31.325757 28633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.314998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:40977 (local address 127.0.0.1:57022)
0809 06:36:31.317608 (+ 2610us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:31.317624 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:31.317755 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:31.318622 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:31.318629 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:31.318657 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:31.319245 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.319261 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.321011 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.321018 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.323152 (+ 2134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.323168 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.325067 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.325073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.325232 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.325265 (+ 33us) client_negotiation.cc:769] Sending connection context
0809 06:36:31.325350 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 06:36:31.325475 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2505,"thread_start_us":2366,"threads_started":1}
I20260809 06:36:31.325994 28635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.315629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57022 (local address 127.30.78.66:40977)
0809 06:36:31.317212 (+ 1583us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:31.317220 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:31.317762 (+ 542us) server_negotiation.cc:407] Connection header received
0809 06:36:31.317885 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:31.317892 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:31.318091 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:31.318287 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:31.319439 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.320857 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.323433 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.324871 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.325020 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.325269 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:31.325421 (+ 152us) server_negotiation.cc:299] Negotiation successful
0809 06:36:31.325588 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1433,"thread_start_us":1311,"threads_started":1}
I20260809 06:36:31.327616 28514 tablet_service.cc:1467] Processing CreateTablet for tablet 578fbd09455b4dd69901b0a743273d84 (DEFAULT_TABLE table=test-table [id=444e2402d6e34f9aa3fe8e863c00472d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:31.328060 28088 tablet_service.cc:1467] Processing CreateTablet for tablet 578fbd09455b4dd69901b0a743273d84 (DEFAULT_TABLE table=test-table [id=444e2402d6e34f9aa3fe8e863c00472d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:31.328842 28514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 578fbd09455b4dd69901b0a743273d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:31.329473 28088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 578fbd09455b4dd69901b0a743273d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:31.329253 28314 tablet_service.cc:1467] Processing CreateTablet for tablet 578fbd09455b4dd69901b0a743273d84 (DEFAULT_TABLE table=test-table [id=444e2402d6e34f9aa3fe8e863c00472d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:31.330601 28314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 578fbd09455b4dd69901b0a743273d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:31.340054 28637 tablet_bootstrap.cc:492] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: Bootstrap starting.
I20260809 06:36:31.342994 28637 tablet_bootstrap.cc:654] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:31.344070 28637 log.cc:824] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:31.345956 28640 tablet_bootstrap.cc:492] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: Bootstrap starting.
I20260809 06:36:31.349565 28640 tablet_bootstrap.cc:654] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:31.349843 28639 tablet_bootstrap.cc:492] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758: Bootstrap starting.
I20260809 06:36:31.350986 28640 log.cc:824] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:31.351927 28637 tablet_bootstrap.cc:492] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: No bootstrap required, opened a new log
I20260809 06:36:31.352229 28637 ts_tablet_manager.cc:1397] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260809 06:36:31.353042 28639 tablet_bootstrap.cc:654] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:31.354138 28640 tablet_bootstrap.cc:492] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: No bootstrap required, opened a new log
I20260809 06:36:31.354247 28639 log.cc:824] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:31.354393 28640 ts_tablet_manager.cc:1397] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260809 06:36:31.362840 28637 raft_consensus.cc:348] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } }
I20260809 06:36:31.363286 28637 raft_consensus.cc:374] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:31.363422 28637 raft_consensus.cc:729] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab03fa4978724eeca0d4292ecaf5c50a, State: Initialized, Role: FOLLOWER
I20260809 06:36:31.364172 28637 consensus_queue.cc:260] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } }
I20260809 06:36:31.365145 28640 raft_consensus.cc:348] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } }
I20260809 06:36:31.366416 28640 raft_consensus.cc:374] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:31.366470 28606 heartbeater.cc:503] Master 127.30.78.126:39997 was elected leader, sending a full tablet report...
I20260809 06:36:31.366564 28640 raft_consensus.cc:729] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 856204109e81473ea6af0c21b55ac270, State: Initialized, Role: FOLLOWER
I20260809 06:36:31.367152 28637 ts_tablet_manager.cc:1428] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: Time spent starting tablet: real 0.015s user 0.011s sys 0.004s
I20260809 06:36:31.367115 28640 consensus_queue.cc:260] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } }
I20260809 06:36:31.369540 28639 tablet_bootstrap.cc:492] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758: No bootstrap required, opened a new log
I20260809 06:36:31.369858 28639 ts_tablet_manager.cc:1397] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.007s
I20260809 06:36:31.371311 28413 heartbeater.cc:503] Master 127.30.78.126:39997 was elected leader, sending a full tablet report...
I20260809 06:36:31.371915 28640 ts_tablet_manager.cc:1428] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: Time spent starting tablet: real 0.017s user 0.008s sys 0.008s
I20260809 06:36:31.377707 28198 heartbeater.cc:503] Master 127.30.78.126:39997 was elected leader, sending a full tablet report...
I20260809 06:36:31.378662 28639 raft_consensus.cc:348] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } }
I20260809 06:36:31.379006 28639 raft_consensus.cc:374] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:31.379110 28639 raft_consensus.cc:729] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c39e1a955a742ddbf6d354ddc188758, State: Initialized, Role: FOLLOWER
I20260809 06:36:31.379626 28639 consensus_queue.cc:260] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } }
I20260809 06:36:31.380995 28639 ts_tablet_manager.cc:1428] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s
W20260809 06:36:31.504364 28607 tablet.cc:2369] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:36:31.560439 28414 tablet.cc:2369] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:36:31.608533 28201 tablet.cc:2369] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:36:31.700521 28652 raft_consensus.cc:482] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:36:31.700789 28652 raft_consensus.cc:504] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } }
I20260809 06:36:31.702462 28652 leader_election.cc:288] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab03fa4978724eeca0d4292ecaf5c50a (127.30.78.67:43409), 856204109e81473ea6af0c21b55ac270 (127.30.78.66:40977)
I20260809 06:36:31.709371 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.702799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:43409 (local address 127.30.78.65:49105)
0809 06:36:31.703407 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:31.703428 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:31.703580 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:31.704042 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:31.704046 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:31.704075 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:31.704402 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.704413 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.705655 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.705661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.707447 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.707463 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.708665 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.708671 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.708826 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.708862 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:36:31.708964 (+ 102us) client_negotiation.cc:240] Negotiation successful
0809 06:36:31.709078 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":35,"thread_start_us":326,"threads_started":1}
I20260809 06:36:31.709362 28630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.702774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:49105 (local address 127.30.78.67:43409)
0809 06:36:31.702930 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:31.702934 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:31.703521 (+ 587us) server_negotiation.cc:407] Connection header received
0809 06:36:31.703766 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:31.703772 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:31.703860 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:31.703947 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:31.704547 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.705526 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.707635 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.708490 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.708607 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.708657 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:31.708996 (+ 339us) server_negotiation.cc:299] Negotiation successful
0809 06:36:31.709123 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 06:36:31.709678 28635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.703838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:33149 (local address 127.30.78.66:40977)
0809 06:36:31.704230 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:31.704236 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:31.704343 (+ 107us) server_negotiation.cc:407] Connection header received
0809 06:36:31.704501 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:31.704507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:31.704588 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:31.704655 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:31.705270 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.706199 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.707965 (+ 1766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.708787 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.708947 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.709011 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:31.709312 (+ 301us) server_negotiation.cc:299] Negotiation successful
0809 06:36:31.709445 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251}
I20260809 06:36:31.709748 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.703534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:40977 (local address 127.30.78.65:33149)
0809 06:36:31.704233 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:31.704250 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:31.704373 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:31.704694 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:31.704698 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:31.704723 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:31.705100 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.705113 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.706323 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.706327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.707783 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:31.707798 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.708979 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.708986 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:31.709156 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.709186 (+ 30us) client_negotiation.cc:769] Sending connection context
0809 06:36:31.709273 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 06:36:31.709395 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"mutex_wait_us":3,"thread_start_us":278,"threads_started":1}
I20260809 06:36:31.710505 28539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "578fbd09455b4dd69901b0a743273d84" candidate_uuid: "7c39e1a955a742ddbf6d354ddc188758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" is_pre_election: true
I20260809 06:36:31.710804 28343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "578fbd09455b4dd69901b0a743273d84" candidate_uuid: "7c39e1a955a742ddbf6d354ddc188758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "856204109e81473ea6af0c21b55ac270" is_pre_election: true
I20260809 06:36:31.710970 28539 raft_consensus.cc:2454] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c39e1a955a742ddbf6d354ddc188758 in term 0.
I20260809 06:36:31.711251 28343 raft_consensus.cc:2454] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c39e1a955a742ddbf6d354ddc188758 in term 0.
I20260809 06:36:31.711513 28016 leader_election.cc:302] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c39e1a955a742ddbf6d354ddc188758, ab03fa4978724eeca0d4292ecaf5c50a; no voters:
I20260809 06:36:31.711910 28652 raft_consensus.cc:2781] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:36:31.712031 28652 raft_consensus.cc:482] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:36:31.712148 28652 raft_consensus.cc:3037] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:31.714316 28652 raft_consensus.cc:504] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } }
I20260809 06:36:31.714851 28652 leader_election.cc:288] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [CANDIDATE]: Term 1 election: Requested vote from peers ab03fa4978724eeca0d4292ecaf5c50a (127.30.78.67:43409), 856204109e81473ea6af0c21b55ac270 (127.30.78.66:40977)
I20260809 06:36:31.715253 28539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "578fbd09455b4dd69901b0a743273d84" candidate_uuid: "7c39e1a955a742ddbf6d354ddc188758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab03fa4978724eeca0d4292ecaf5c50a"
I20260809 06:36:31.715329 28343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "578fbd09455b4dd69901b0a743273d84" candidate_uuid: "7c39e1a955a742ddbf6d354ddc188758" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "856204109e81473ea6af0c21b55ac270"
I20260809 06:36:31.715425 28539 raft_consensus.cc:3037] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:31.715521 28343 raft_consensus.cc:3037] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:31.717574 28539 raft_consensus.cc:2454] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c39e1a955a742ddbf6d354ddc188758 in term 1.
I20260809 06:36:31.717613 28343 raft_consensus.cc:2454] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c39e1a955a742ddbf6d354ddc188758 in term 1.
I20260809 06:36:31.717944 28016 leader_election.cc:302] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c39e1a955a742ddbf6d354ddc188758, ab03fa4978724eeca0d4292ecaf5c50a; no voters:
I20260809 06:36:31.718204 28652 raft_consensus.cc:2781] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:31.718595 28652 raft_consensus.cc:686] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 1 LEADER]: Becoming Leader. State: Replica: 7c39e1a955a742ddbf6d354ddc188758, State: Running, Role: LEADER
I20260809 06:36:31.719027 28652 consensus_queue.cc:237] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } }
I20260809 06:36:31.723475 27903 catalog_manager.cc:5495] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c39e1a955a742ddbf6d354ddc188758 (127.30.78.65). New cstate: current_term: 1 leader_uuid: "7c39e1a955a742ddbf6d354ddc188758" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c39e1a955a742ddbf6d354ddc188758" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 34407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 } health_report { overall_health: UNKNOWN } } }
I20260809 06:36:31.775957 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.770458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54330 (local address 127.30.78.65:34407)
0809 06:36:31.770648 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:31.770653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:31.770695 (+ 42us) server_negotiation.cc:407] Connection header received
0809 06:36:31.770921 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:31.770927 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:31.771033 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:31.771162 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:36:31.771564 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.772255 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.773610 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.774219 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.774330 (+ 111us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.774890 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:36:31.775354 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:36:31.775520 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:31.775677 (+ 157us) server_negotiation.cc:299] Negotiation successful
0809 06:36:31.775720 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 06:36:31.783932 28343 raft_consensus.cc:1261] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [term 1 FOLLOWER]: Refusing update from remote peer 7c39e1a955a742ddbf6d354ddc188758: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:31.783932 28539 raft_consensus.cc:1261] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [term 1 FOLLOWER]: Refusing update from remote peer 7c39e1a955a742ddbf6d354ddc188758: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:31.784868 28655 consensus_queue.cc:1035] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "856204109e81473ea6af0c21b55ac270" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 40977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:31.785210 28652 consensus_queue.cc:1035] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab03fa4978724eeca0d4292ecaf5c50a" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 43409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:31.795763 28661 mvcc.cc:205] Tried to move back new op lower bound from 7316510276736380928 to 7316510276484235264. Current Snapshot: MvccSnapshot[applied={T|T < 7316510276736380928}]
I20260809 06:36:31.840204 27903 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:31.840427 27903 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:31.843462 27903 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b029099af47f49c9b857188b7c7f83b3: Sending DeleteTablet for 3 replicas of tablet 578fbd09455b4dd69901b0a743273d84
I20260809 06:36:31.844599 28088 tablet_service.cc:1514] Processing DeleteTablet for tablet 578fbd09455b4dd69901b0a743273d84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:31 UTC) from {username='slave'} at 127.0.0.1:54328
I20260809 06:36:31.844553 28514 tablet_service.cc:1514] Processing DeleteTablet for tablet 578fbd09455b4dd69901b0a743273d84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:31 UTC) from {username='slave'} at 127.0.0.1:45318
I20260809 06:36:31.845461 28314 tablet_service.cc:1514] Processing DeleteTablet for tablet 578fbd09455b4dd69901b0a743273d84 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:31 UTC) from {username='slave'} at 127.0.0.1:57022
I20260809 06:36:31.846855 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 27992
I20260809 06:36:31.859933 28676 tablet_replica.cc:330] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: stopping tablet replica
I20260809 06:36:31.860502 28676 raft_consensus.cc:2229] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:31.861119 28676 raft_consensus.cc:2258] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:31.863143 28676 ts_tablet_manager.cc:1905] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:31.870659 28676 ts_tablet_manager.cc:1918] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:31.870829 28676 log.cc:1196] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/578fbd09455b4dd69901b0a743273d84
I20260809 06:36:31.871348 28676 ts_tablet_manager.cc:1939] T 578fbd09455b4dd69901b0a743273d84 P ab03fa4978724eeca0d4292ecaf5c50a: Deleting consensus metadata
I20260809 06:36:31.873152 27879 catalog_manager.cc:4841] TS ab03fa4978724eeca0d4292ecaf5c50a (127.30.78.67:43409): tablet 578fbd09455b4dd69901b0a743273d84 (table test-table [id=444e2402d6e34f9aa3fe8e863c00472d]) successfully deleted
I20260809 06:36:31.874204 28677 tablet_replica.cc:330] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: stopping tablet replica
I20260809 06:36:31.874709 28677 raft_consensus.cc:2229] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:31.875254 28677 raft_consensus.cc:2258] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:31.876101 28675 tablet_replica.cc:330] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758: stopping tablet replica
I20260809 06:36:31.876528 28675 raft_consensus.cc:2229] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:36:31.877220 28675 raft_consensus.cc:2258] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:31.877415 28677 ts_tablet_manager.cc:1905] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:31.879158 28675 ts_tablet_manager.cc:1905] T 578fbd09455b4dd69901b0a743273d84 P 7c39e1a955a742ddbf6d354ddc188758: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:31.882217 28632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:31.848228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54344 (local address 127.30.78.65:34407)
0809 06:36:31.848416 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:31.848422 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:31.873850 (+ 25428us) server_negotiation.cc:407] Connection header received
0809 06:36:31.874133 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:31.874139 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:31.874237 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:31.874310 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:31.875053 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.876298 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.878202 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:31.878916 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:31.879034 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:31.880464 (+ 1430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:31.880474 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:31.880489 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:31.881271 (+ 782us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:31.881328 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:31.881353 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:31.881473 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:31.881738 (+ 265us) server_negotiation.cc:299] Negotiation successful
0809 06:36:31.881842 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:36:31.883514 28191 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:31.885268 28677 ts_tablet_manager.cc:1918] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:31.885426 28677 log.cc:1196] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/578fbd09455b4dd69901b0a743273d84
I20260809 06:36:31.885977 28677 ts_tablet_manager.cc:1939] T 578fbd09455b4dd69901b0a743273d84 P 856204109e81473ea6af0c21b55ac270: Deleting consensus metadata
I20260809 06:36:31.887645 27879 catalog_manager.cc:4841] TS 856204109e81473ea6af0c21b55ac270 (127.30.78.66:40977): tablet 578fbd09455b4dd69901b0a743273d84 (table test-table [id=444e2402d6e34f9aa3fe8e863c00472d]) successfully deleted
I20260809 06:36:31.977823 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 27992
I20260809 06:36:31.999938 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 28205
W20260809 06:36:32.000062 27883 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.78.65:34407 (error 108)
I20260809 06:36:32.002162 28683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:32.001346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34407 (local address 127.0.0.1:54360)
0809 06:36:32.001860 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:32.001975 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:34407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":214,"threads_started":1}
W20260809 06:36:32.002393 27883 catalog_manager.cc:4584] TS 7c39e1a955a742ddbf6d354ddc188758 (127.30.78.65:34407): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 578fbd09455b4dd69901b0a743273d84: Network error: Client connection negotiation failed: client connection to 127.30.78.65:34407: connect: Connection refused (error 111)
I20260809 06:36:32.007025 28635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:32.000753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57026 (local address 127.30.78.66:40977)
0809 06:36:32.000950 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:32.000956 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:32.001065 (+ 109us) server_negotiation.cc:407] Connection header received
0809 06:36:32.001252 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:32.001257 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:32.001360 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:32.001452 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:32.001922 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:32.002751 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:32.004123 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:32.004555 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:32.004663 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:32.005656 (+ 993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:32.005665 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:32.005678 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:32.006303 (+ 625us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:32.006349 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:32.006369 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:32.006479 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:32.006611 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 06:36:32.006716 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260809 06:36:32.007750 28407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:32.055641 28683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:32.055222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34407 (local address 127.0.0.1:54374)
0809 06:36:32.055417 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:32.055507 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:34407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260809 06:36:32.056578 28683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:32.056233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34407 (local address 127.0.0.1:54388)
0809 06:36:32.056379 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:32.056445 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:34407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 06:36:32.096233 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 28205
I20260809 06:36:32.117019 28683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:32.116567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34407 (local address 127.0.0.1:54394)
0809 06:36:32.116772 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:32.116860 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:34407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 06:36:32.117547 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 28418
I20260809 06:36:32.118284 28683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:32.117905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34407 (local address 127.0.0.1:54396)
0809 06:36:32.118045 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:32.118114 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:34407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260809 06:36:32.124176 28630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:32.118287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45322 (local address 127.30.78.67:43409)
0809 06:36:32.118504 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:32.118509 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:32.118528 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:36:32.118654 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:32.118660 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:32.118767 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:32.118857 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:32.119292 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:32.120003 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:32.121268 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:32.121662 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:32.121807 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:32.122863 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:32.122872 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:32.122895 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:32.123449 (+ 554us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:32.123499 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:32.123521 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:32.123621 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:32.123753 (+ 132us) server_negotiation.cc:299] Negotiation successful
0809 06:36:32.123885 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260809 06:36:32.124785 28599 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:32.199142 28683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:32.198620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34407 (local address 127.0.0.1:54400)
0809 06:36:32.198888 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:32.198988 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:34407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260809 06:36:32.200238 28683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:32.199842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:34407 (local address 127.0.0.1:54412)
0809 06:36:32.200036 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:32.200108 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:34407: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260809 06:36:32.210613 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 28418
I20260809 06:36:32.231240 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 27857
I20260809 06:36:32.232364 27949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:32.336195 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 27857
2026-08-09T06:36:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3030 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:32 dist-test-slave-cvwc krb5kdc[28692](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:32 dist-test-slave-cvwc krb5kdc[28692](info): set up 2 sockets
Aug 09 06:36:32 dist-test-slave-cvwc krb5kdc[28692](info): commencing operation
krb5kdc: starting...
W20260809 06:36:33.542582 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:33 dist-test-slave-cvwc krb5kdc[28692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:36:33.795094 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:44541
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:43877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:44541
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:34.114078 28711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:34.114346 28711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:34.114485 28711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:34.121459 28711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:34.121560 28711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:34.121635 28711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:34.121703 28711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:34.121781 28711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:34.131069 28711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:43877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:44541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:44541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:34.132272 28711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:34.133533 28711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:34.144630 28719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:34.144656 28724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:34.144574 28721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:34.145367 28711 server_base.cc:1034] running on GCE node
I20260809 06:36:34.146121 28711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:34.147294 28711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:34.148484 28711 hybrid_clock.cc:648] HybridClock initialized: now 1786257394148438 us; error 34 us; skew 500 ppm
I20260809 06:36:34.148763 28711 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:34 dist-test-slave-cvwc krb5kdc[28692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257394, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:34.155802 28711 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:36:34.157065 28711 webserver.cc:460] Webserver started at http://127.30.78.126:44555/ using document root <none> and password file <none>
I20260809 06:36:34.157644 28711 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:34.157770 28711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:34.158043 28711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:34.160838 28711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "42234fe844c24dd2ad1d0bc6dd0e5385"
format_stamp: "Formatted at 2026-08-09 06:36:34 on dist-test-slave-cvwc"
server_key: "352c04c1bb3a6359f945bbc4de4d80fe"
server_key_iv: "753a3bad1fda9f75364efdc4f003762b"
server_key_version: "encryptionkey@0"
I20260809 06:36:34.161573 28711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "42234fe844c24dd2ad1d0bc6dd0e5385"
format_stamp: "Formatted at 2026-08-09 06:36:34 on dist-test-slave-cvwc"
server_key: "352c04c1bb3a6359f945bbc4de4d80fe"
server_key_iv: "753a3bad1fda9f75364efdc4f003762b"
server_key_version: "encryptionkey@0"
I20260809 06:36:34.166273 28711 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260809 06:36:34.169327 28735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:34.170529 28711 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:34.170657 28711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "42234fe844c24dd2ad1d0bc6dd0e5385"
format_stamp: "Formatted at 2026-08-09 06:36:34 on dist-test-slave-cvwc"
server_key: "352c04c1bb3a6359f945bbc4de4d80fe"
server_key_iv: "753a3bad1fda9f75364efdc4f003762b"
server_key_version: "encryptionkey@0"
I20260809 06:36:34.170804 28711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:34.190488 28711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:34.194355 28711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:34.194571 28711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:34.211130 28711 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:44541
I20260809 06:36:34.211161 28821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:44541 every 8 connection(s)
I20260809 06:36:34.212381 28711 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:34.215569 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 28711
I20260809 06:36:34.215750 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:34.216041 28823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:34.216279 31033 external_mini_cluster.cc:1428] Setting key 1f062eeb91104973d36f91eef467aad4
I20260809 06:36:34.229738 28823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385: Bootstrap starting.
Aug 09 06:36:34 dist-test-slave-cvwc krb5kdc[28692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:34.233084 28823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:34.234158 28823 log.cc:824] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:34.237040 28823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385: No bootstrap required, opened a new log
I20260809 06:36:34.238430 28827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:34.218047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58252 (local address 127.30.78.126:44541)
0809 06:36:34.218827 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:34.218838 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:34.218882 (+ 44us) server_negotiation.cc:407] Connection header received
0809 06:36:34.220602 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:34.220622 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:34.220962 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:34.221269 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:34.223058 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:34.224291 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:34.226034 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:34.226715 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:34.226851 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:34.231620 (+ 4769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:34.231627 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:34.231640 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:34.231679 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:34.234588 (+ 2909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:34.235309 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:34.235315 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:34.235321 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:34.235491 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:34.235884 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:34.235888 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:34.235890 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:34.236368 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:34.236592 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:34.237016 (+ 424us) server_negotiation.cc:299] Negotiation successful
0809 06:36:34.237394 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":380,"threads_started":1}
I20260809 06:36:34.244313 28823 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42234fe844c24dd2ad1d0bc6dd0e5385" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44541 } }
I20260809 06:36:34.244658 28823 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:34.244750 28823 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42234fe844c24dd2ad1d0bc6dd0e5385, State: Initialized, Role: FOLLOWER
I20260809 06:36:34.245374 28823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42234fe844c24dd2ad1d0bc6dd0e5385" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44541 } }
I20260809 06:36:34.245597 28823 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:34.245695 28823 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:34.245862 28823 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:34.247823 28823 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42234fe844c24dd2ad1d0bc6dd0e5385" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44541 } }
I20260809 06:36:34.248243 28823 leader_election.cc:302] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42234fe844c24dd2ad1d0bc6dd0e5385; no voters:
I20260809 06:36:34.248733 28823 leader_election.cc:288] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:34.248852 28830 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:34.249481 28830 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [term 1 LEADER]: Becoming Leader. State: Replica: 42234fe844c24dd2ad1d0bc6dd0e5385, State: Running, Role: LEADER
I20260809 06:36:34.250013 28830 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42234fe844c24dd2ad1d0bc6dd0e5385" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44541 } }
I20260809 06:36:34.250564 28823 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:34.252784 28832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42234fe844c24dd2ad1d0bc6dd0e5385. Latest consensus state: current_term: 1 leader_uuid: "42234fe844c24dd2ad1d0bc6dd0e5385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42234fe844c24dd2ad1d0bc6dd0e5385" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44541 } } }
I20260809 06:36:34.253187 28832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:34.253376 28831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42234fe844c24dd2ad1d0bc6dd0e5385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42234fe844c24dd2ad1d0bc6dd0e5385" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 44541 } } }
I20260809 06:36:34.253676 28831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:34.255216 28845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:34.259403 28845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:34.266784 28845 catalog_manager.cc:1347] Generated new cluster ID: 6dc859aa0e134c8abaa6c86545c3baea
I20260809 06:36:34.266896 28845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:34.276775 28845 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:34.278548 28845 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:34.291195 28845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385: Generated new TSK 0
I20260809 06:36:34.292142 28845 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.78.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
Entry for principal kudu/127.30.78.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab.
I20260809 06:36:34.352309 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44541
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:43877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:34.671548 28863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:34.671810 28863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:34.671962 28863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:34.679418 28863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:34.679519 28863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:34.679680 28863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:36:34.689093 28863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:43877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.65.keytab
--principal=kudu/127.30.78.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:34.690379 28863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:34.691650 28863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:34.703909 28876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:34.703958 28873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:34.703987 28871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:34.704784 28863 server_base.cc:1034] running on GCE node
I20260809 06:36:34.705331 28863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:34.706221 28863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:34.707415 28863 hybrid_clock.cc:648] HybridClock initialized: now 1786257394707372 us; error 34 us; skew 500 ppm
I20260809 06:36:34.707700 28863 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:34 dist-test-slave-cvwc krb5kdc[28692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257394, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:34.710618 28863 init.cc:377] Logged in from keytab as kudu/127.30.78.65@KRBTEST.COM (short username kudu)
I20260809 06:36:34.711925 28863 webserver.cc:460] Webserver started at http://127.30.78.65:39389/ using document root <none> and password file <none>
I20260809 06:36:34.712551 28863 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:34.712669 28863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:34.712972 28863 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:34.715761 28863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "fef7d2cedb1e4605936040795c9125b1"
format_stamp: "Formatted at 2026-08-09 06:36:34 on dist-test-slave-cvwc"
server_key: "d6dfa5bca1301b9683bb1e4e757fd655"
server_key_iv: "7346f4d45fc85f141c0df899b4e665ee"
server_key_version: "encryptionkey@0"
I20260809 06:36:34.716495 28863 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "fef7d2cedb1e4605936040795c9125b1"
format_stamp: "Formatted at 2026-08-09 06:36:34 on dist-test-slave-cvwc"
server_key: "d6dfa5bca1301b9683bb1e4e757fd655"
server_key_iv: "7346f4d45fc85f141c0df899b4e665ee"
server_key_version: "encryptionkey@0"
I20260809 06:36:34.721302 28863 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260809 06:36:34.724522 28885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:34.725697 28863 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:36:34.725886 28863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "fef7d2cedb1e4605936040795c9125b1"
format_stamp: "Formatted at 2026-08-09 06:36:34 on dist-test-slave-cvwc"
server_key: "d6dfa5bca1301b9683bb1e4e757fd655"
server_key_iv: "7346f4d45fc85f141c0df899b4e665ee"
server_key_version: "encryptionkey@0"
I20260809 06:36:34.726069 28863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:34.735832 28863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:34.739459 28863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:34.739705 28863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:34.740518 28863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:34.741688 28863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:34.741796 28863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:34.741918 28863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:34.741972 28863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:34.769105 28863 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:33371
I20260809 06:36:34.769143 29069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:33371 every 8 connection(s)
I20260809 06:36:34.770339 28863 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:36:34.775240 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 28863
I20260809 06:36:34.775403 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:36:34.775804 31033 external_mini_cluster.cc:1428] Setting key fcf58f968b1a31bca99134645f55fc7f
Aug 09 06:36:34 dist-test-slave-cvwc krb5kdc[28692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257394, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.65@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:34.788933 29075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:34.772712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:47799 (local address 127.30.78.126:44541)
0809 06:36:34.773103 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:34.773107 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:34.774100 (+ 993us) server_negotiation.cc:407] Connection header received
0809 06:36:34.775962 (+ 1862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:34.775967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:34.776047 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:34.776143 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:34.777797 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:34.778512 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:34.780009 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:34.780415 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:34.780522 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:34.783847 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:34.783852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:34.783855 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:34.783888 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:34.786211 (+ 2323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:34.786887 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:34.786891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:34.786893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:34.787010 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:34.787421 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:34.787425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:34.787427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:34.787705 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:34.787836 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:34.788504 (+ 668us) server_negotiation.cc:299] Negotiation successful
0809 06:36:34.788670 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":192,"threads_started":1}
I20260809 06:36:34.790175 29077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:34.773238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:44541 (local address 127.30.78.65:47799)
0809 06:36:34.773956 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:34.773994 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:34.775701 (+ 1707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:34.776384 (+ 683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:34.776392 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:34.777011 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:34.777628 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:34.777647 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:34.778663 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:34.778667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:34.779852 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:34.779865 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:34.780626 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:34.780634 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:34.780859 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:34.781475 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:36:34.781496 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:34.783647 (+ 2151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:34.786348 (+ 2701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:34.786357 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:34.786374 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:34.786765 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:34.787112 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:34.787117 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:34.787120 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:34.787301 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:34.787834 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:34.787842 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:34.788140 (+ 298us) client_negotiation.cc:769] Sending connection context
0809 06:36:34.788380 (+ 240us) client_negotiation.cc:240] Negotiation successful
0809 06:36:34.788869 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":263,"threads_started":1}
I20260809 06:36:34.791659 29070 heartbeater.cc:347] Connected to a master server at 127.30.78.126:44541
I20260809 06:36:34.792019 29070 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:34.792758 29070 heartbeater.cc:511] Master 127.30.78.126:44541 requested a full tablet report, sending...
I20260809 06:36:34.794806 28763 ts_manager.cc:194] Registered new tserver with Master: fef7d2cedb1e4605936040795c9125b1 (127.30.78.65:33371)
I20260809 06:36:34.796167 28763 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.65@KRBTEST.COM'} at 127.30.78.65:47799
WARNING: no policy specified for kudu/127.30.78.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
Entry for principal kudu/127.30.78.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab.
I20260809 06:36:34.834113 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44541
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:43877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:35.152117 29082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:35.152366 29082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:35.152509 29082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:35.159513 29082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:35.159619 29082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:35.159766 29082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:36:35.169198 29082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:43877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.66.keytab
--principal=kudu/127.30.78.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:35.170351 29082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:35.171603 29082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:35.183616 29089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:35.183692 29091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:35.183873 29096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:35.184573 29082 server_base.cc:1034] running on GCE node
I20260809 06:36:35.185113 29082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:35.185967 29082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:35.187165 29082 hybrid_clock.cc:648] HybridClock initialized: now 1786257395187116 us; error 40 us; skew 500 ppm
I20260809 06:36:35.187464 29082 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:35 dist-test-slave-cvwc krb5kdc[28692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257395, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:35.190377 29082 init.cc:377] Logged in from keytab as kudu/127.30.78.66@KRBTEST.COM (short username kudu)
I20260809 06:36:35.191625 29082 webserver.cc:460] Webserver started at http://127.30.78.66:44055/ using document root <none> and password file <none>
I20260809 06:36:35.192203 29082 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:35.192298 29082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:35.192552 29082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:35.195235 29082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "bb1f0a02a2164dbab2c47d0b0a767852"
format_stamp: "Formatted at 2026-08-09 06:36:35 on dist-test-slave-cvwc"
server_key: "3d08e2be5659f899b0d8f4b14481ac3d"
server_key_iv: "07db9348618c27e92343388a872bebcd"
server_key_version: "encryptionkey@0"
I20260809 06:36:35.195922 29082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "bb1f0a02a2164dbab2c47d0b0a767852"
format_stamp: "Formatted at 2026-08-09 06:36:35 on dist-test-slave-cvwc"
server_key: "3d08e2be5659f899b0d8f4b14481ac3d"
server_key_iv: "07db9348618c27e92343388a872bebcd"
server_key_version: "encryptionkey@0"
I20260809 06:36:35.200707 29082 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 06:36:35.203866 29104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:35.205047 29082 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:36:35.205178 29082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "bb1f0a02a2164dbab2c47d0b0a767852"
format_stamp: "Formatted at 2026-08-09 06:36:35 on dist-test-slave-cvwc"
server_key: "3d08e2be5659f899b0d8f4b14481ac3d"
server_key_iv: "07db9348618c27e92343388a872bebcd"
server_key_version: "encryptionkey@0"
I20260809 06:36:35.205343 29082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:35.226356 29082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:35.230360 29082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:35.230618 29082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:35.231472 29082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:35.232657 29082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:35.232731 29082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:35.232857 29082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:35.232910 29082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:35.262856 29082 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:39153
I20260809 06:36:35.262920 29293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:39153 every 8 connection(s)
I20260809 06:36:35.264084 29082 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:36:35.268085 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 29082
I20260809 06:36:35.268278 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:36:35.268874 31033 external_mini_cluster.cc:1428] Setting key 1722c8947c73d2b39af2de9b6eab8617
Aug 09 06:36:35 dist-test-slave-cvwc krb5kdc[28692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257395, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.66@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:35.286561 29075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.266544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:58053 (local address 127.30.78.126:44541)
0809 06:36:35.266762 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:35.266768 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:35.268106 (+ 1338us) server_negotiation.cc:407] Connection header received
0809 06:36:35.270579 (+ 2473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:35.270584 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:35.270664 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:35.270799 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:35.272782 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.273509 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.275694 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.276103 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.276200 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.280102 (+ 3902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:35.280108 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:35.280112 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:35.280150 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:35.283396 (+ 3246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:35.284157 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:35.284162 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:35.284165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:35.284319 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:35.284773 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:35.284779 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:35.284783 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:35.285175 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:35.285376 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:35.286110 (+ 734us) server_negotiation.cc:299] Negotiation successful
0809 06:36:35.286311 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260809 06:36:35.287981 29298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.267015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:44541 (local address 127.30.78.66:58053)
0809 06:36:35.267907 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:35.267959 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:35.270306 (+ 2347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:35.271048 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:35.271056 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:35.271797 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:35.272570 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.272597 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.273758 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.273765 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.275554 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.275568 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.276320 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.276327 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.276576 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.277264 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:36:35.277291 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:35.279874 (+ 2583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:35.283551 (+ 3677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:35.283558 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:35.283570 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:35.284008 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:35.284449 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:35.284452 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:35.284454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:35.284630 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:35.285308 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:35.285314 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:35.285692 (+ 378us) client_negotiation.cc:769] Sending connection context
0809 06:36:35.285992 (+ 300us) client_negotiation.cc:240] Negotiation successful
0809 06:36:35.286505 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":298,"threads_started":1}
I20260809 06:36:35.289502 29295 heartbeater.cc:347] Connected to a master server at 127.30.78.126:44541
I20260809 06:36:35.289868 29295 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:35.290664 29295 heartbeater.cc:511] Master 127.30.78.126:44541 requested a full tablet report, sending...
I20260809 06:36:35.292460 28763 ts_manager.cc:194] Registered new tserver with Master: bb1f0a02a2164dbab2c47d0b0a767852 (127.30.78.66:39153)
I20260809 06:36:35.293280 28763 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.66@KRBTEST.COM'} at 127.30.78.66:58053
WARNING: no policy specified for kudu/127.30.78.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
Entry for principal kudu/127.30.78.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab.
I20260809 06:36:35.330802 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44541
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:43877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:35.647292 29301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:35.647631 29301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:35.647783 29301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:35.657526 29301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:35.657644 29301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:35.657841 29301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:36:35.667217 29301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:43877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.67.keytab
--principal=kudu/127.30.78.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:44541
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:35.668344 29301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:35.669556 29301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:35.681855 29308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:35.681900 29310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:35.682030 29313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:35.682920 29301 server_base.cc:1034] running on GCE node
I20260809 06:36:35.683446 29301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:35.684262 29301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:35.685441 29301 hybrid_clock.cc:648] HybridClock initialized: now 1786257395685387 us; error 53 us; skew 500 ppm
I20260809 06:36:35.685755 29301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:35 dist-test-slave-cvwc krb5kdc[28692](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257395, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:35.688678 29301 init.cc:377] Logged in from keytab as kudu/127.30.78.67@KRBTEST.COM (short username kudu)
I20260809 06:36:35.690083 29301 webserver.cc:460] Webserver started at http://127.30.78.67:33643/ using document root <none> and password file <none>
I20260809 06:36:35.690698 29301 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:35.690811 29301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:35.691105 29301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:35.693866 29301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "40927feed6f54c3aa2d6dceaca379685"
format_stamp: "Formatted at 2026-08-09 06:36:35 on dist-test-slave-cvwc"
server_key: "cec9eacbdfdf1355fbcb270b109baf8e"
server_key_iv: "926fb4396b2d0a9e01899abe65a49cc7"
server_key_version: "encryptionkey@0"
I20260809 06:36:35.694584 29301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "40927feed6f54c3aa2d6dceaca379685"
format_stamp: "Formatted at 2026-08-09 06:36:35 on dist-test-slave-cvwc"
server_key: "cec9eacbdfdf1355fbcb270b109baf8e"
server_key_iv: "926fb4396b2d0a9e01899abe65a49cc7"
server_key_version: "encryptionkey@0"
I20260809 06:36:35.699280 29301 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:36:35.702440 29324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:35.703621 29301 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:35.703763 29301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "40927feed6f54c3aa2d6dceaca379685"
format_stamp: "Formatted at 2026-08-09 06:36:35 on dist-test-slave-cvwc"
server_key: "cec9eacbdfdf1355fbcb270b109baf8e"
server_key_iv: "926fb4396b2d0a9e01899abe65a49cc7"
server_key_version: "encryptionkey@0"
I20260809 06:36:35.703964 29301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:35.727233 29301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:35.731037 29301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:35.731287 29301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:35.732159 29301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:35.733352 29301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:35.733428 29301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:35.733547 29301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:35.733599 29301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:35.763171 29301 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:38233
I20260809 06:36:35.763245 29517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:38233 every 8 connection(s)
I20260809 06:36:35.764400 29301 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:36:35.771025 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 29301
I20260809 06:36:35.771200 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:36:35.771631 31033 external_mini_cluster.cc:1428] Setting key e4e3c0e1f5f5397fd1e10d213ab185a4
Aug 09 06:36:35 dist-test-slave-cvwc krb5kdc[28692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257395, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.67@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:36:35.784973 29075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.766780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:60489 (local address 127.30.78.126:44541)
0809 06:36:35.766949 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:35.766953 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:35.768086 (+ 1133us) server_negotiation.cc:407] Connection header received
0809 06:36:35.770539 (+ 2453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:35.770544 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:35.770617 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:35.770731 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:35.772795 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.773703 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.775589 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.776002 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.776096 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.779219 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:35.779223 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:35.779227 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:35.779260 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:35.781780 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:35.782522 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:35.782529 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:35.782533 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:35.782666 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:35.783118 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:35.783124 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:35.783126 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:35.783432 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:35.783582 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:35.784285 (+ 703us) server_negotiation.cc:299] Negotiation successful
0809 06:36:35.784536 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:36:35.786142 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.767275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:44541 (local address 127.30.78.67:60489)
0809 06:36:35.767939 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:35.767976 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:35.770240 (+ 2264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:35.770968 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:35.770979 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:35.771714 (+ 735us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:35.772484 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.772510 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.773899 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.773904 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.775469 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.775482 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.776165 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.776169 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.776351 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.776903 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:36:35.776924 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:35.779020 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:35.781915 (+ 2895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:35.781925 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:35.781940 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:35.782395 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:35.782788 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:36:35.782794 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:36:35.782799 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:36:35.783000 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:36:35.783578 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:35.783586 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:35.783899 (+ 313us) client_negotiation.cc:769] Sending connection context
0809 06:36:35.784162 (+ 263us) client_negotiation.cc:240] Negotiation successful
0809 06:36:35.784672 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":252,"threads_started":1}
I20260809 06:36:35.787432 29519 heartbeater.cc:347] Connected to a master server at 127.30.78.126:44541
I20260809 06:36:35.787709 29519 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:35.788354 29519 heartbeater.cc:511] Master 127.30.78.126:44541 requested a full tablet report, sending...
I20260809 06:36:35.789693 28763 ts_manager.cc:194] Registered new tserver with Master: 40927feed6f54c3aa2d6dceaca379685 (127.30.78.67:38233)
I20260809 06:36:35.790489 28763 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.78.67@KRBTEST.COM'} at 127.30.78.67:60489
I20260809 06:36:35.798604 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:36:35.799369 29070 heartbeater.cc:503] Master 127.30.78.126:44541 was elected leader, sending a full tablet report...
I20260809 06:36:35.814220 29075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.802742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58268 (local address 127.30.78.126:44541)
0809 06:36:35.802944 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:35.802950 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:35.803254 (+ 304us) server_negotiation.cc:407] Connection header received
0809 06:36:35.803373 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:35.803377 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:35.803433 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:35.803502 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:35.804805 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.805491 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.806721 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.807115 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.807241 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.809511 (+ 2270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:35.809516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:35.809519 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:35.809548 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:35.811767 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:35.812396 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:35.812402 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:35.812405 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:35.812526 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:35.812874 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:35.812879 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:35.812882 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:35.813158 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:35.813400 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:35.813708 (+ 308us) server_negotiation.cc:299] Negotiation successful
0809 06:36:35.813942 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:36:35.817368 28763 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:36:35.823957 28763 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:36:35.846313 29536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.835011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34414 (local address 127.30.78.67:38233)
0809 06:36:35.835761 (+ 750us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:35.835770 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:35.836333 (+ 563us) server_negotiation.cc:407] Connection header received
0809 06:36:35.836713 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:35.836723 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:35.836990 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:35.837147 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:35.838209 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.839946 (+ 1737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.842919 (+ 2973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.844420 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.844526 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.844760 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:35.845699 (+ 939us) server_negotiation.cc:299] Negotiation successful
0809 06:36:35.845924 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":427,"threads_started":1}
I20260809 06:36:35.847186 29534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.834741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:38233 (local address 127.0.0.1:34414)
0809 06:36:35.836190 (+ 1449us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:35.836230 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:35.836480 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:35.837521 (+ 1041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:35.837529 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:35.837561 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:35.837995 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.838008 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.840166 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.840172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.842712 (+ 2540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.842729 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.844980 (+ 2251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.844986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.845411 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.845469 (+ 58us) client_negotiation.cc:769] Sending connection context
0809 06:36:35.846562 (+ 1093us) client_negotiation.cc:240] Negotiation successful
0809 06:36:35.846788 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1192,"thread_start_us":1160,"threads_started":1}
I20260809 06:36:35.851558 29406 tablet_service.cc:1467] Processing CreateTablet for tablet 6c278e29f36c449a9058921432515a38 (DEFAULT_TABLE table=test-table [id=27425c19a5784df9b96ffbef73cad078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:35.853211 29406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c278e29f36c449a9058921432515a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:35.855636 29539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.835144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:33371 (local address 127.0.0.1:40634)
0809 06:36:35.845511 (+ 10367us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:35.845532 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:35.846468 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:35.847383 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:35.847387 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:35.847412 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:35.847802 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.847812 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.849883 (+ 2071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.849889 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.852188 (+ 2299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.852205 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.854902 (+ 2697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.854907 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.855083 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.855114 (+ 31us) client_negotiation.cc:769] Sending connection context
0809 06:36:35.855201 (+ 87us) client_negotiation.cc:240] Negotiation successful
0809 06:36:35.855319 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10232,"thread_start_us":17321,"threads_started":1}
I20260809 06:36:35.855758 29538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.835696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40634 (local address 127.30.78.65:33371)
0809 06:36:35.836299 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:35.836307 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:35.845639 (+ 9332us) server_negotiation.cc:407] Connection header received
0809 06:36:35.846656 (+ 1017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:35.846667 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:35.846933 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:35.847106 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:35.848011 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.849678 (+ 1667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.853156 (+ 3478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.854656 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.854798 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.855019 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:35.855265 (+ 246us) server_negotiation.cc:299] Negotiation successful
0809 06:36:35.855434 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":992,"threads_started":1}
I20260809 06:36:35.859277 28966 tablet_service.cc:1467] Processing CreateTablet for tablet 6c278e29f36c449a9058921432515a38 (DEFAULT_TABLE table=test-table [id=27425c19a5784df9b96ffbef73cad078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:35.860320 29537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.836587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:39153 (local address 127.0.0.1:56494)
0809 06:36:35.852770 (+ 16183us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:35.852789 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:35.852897 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:35.854504 (+ 1607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:35.854508 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:35.854530 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:35.854900 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.854910 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.857047 (+ 2137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.857053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.858365 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.858379 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.859578 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.859584 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.859737 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.859760 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 06:36:35.859836 (+ 76us) client_negotiation.cc:240] Negotiation successful
0809 06:36:35.860033 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16038,"thread_start_us":9081,"threads_started":1}
I20260809 06:36:35.860715 28966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c278e29f36c449a9058921432515a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:35.861240 29540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.836838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56494 (local address 127.30.78.66:39153)
0809 06:36:35.854077 (+ 17239us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:35.854084 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:35.854107 (+ 23us) server_negotiation.cc:407] Connection header received
0809 06:36:35.854177 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:35.854182 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:35.854328 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:35.854493 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:35.855089 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.856897 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.858519 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.859392 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.859510 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.859694 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:35.859888 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 06:36:35.860041 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17092,"thread_start_us":16983,"threads_started":1}
I20260809 06:36:35.863899 29187 tablet_service.cc:1467] Processing CreateTablet for tablet 6c278e29f36c449a9058921432515a38 (DEFAULT_TABLE table=test-table [id=27425c19a5784df9b96ffbef73cad078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:35.864961 29187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c278e29f36c449a9058921432515a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:35.867630 29541 tablet_bootstrap.cc:492] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: Bootstrap starting.
I20260809 06:36:35.871135 29541 tablet_bootstrap.cc:654] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:35.872439 29541 log.cc:824] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:35.873468 29543 tablet_bootstrap.cc:492] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: Bootstrap starting.
I20260809 06:36:35.876821 29543 tablet_bootstrap.cc:654] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:35.876947 29541 tablet_bootstrap.cc:492] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: No bootstrap required, opened a new log
I20260809 06:36:35.877221 29541 ts_tablet_manager.cc:1397] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260809 06:36:35.878173 29546 tablet_bootstrap.cc:492] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: Bootstrap starting.
I20260809 06:36:35.878326 29543 log.cc:824] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:35.881450 29543 tablet_bootstrap.cc:492] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: No bootstrap required, opened a new log
I20260809 06:36:35.881491 29546 tablet_bootstrap.cc:654] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:35.881747 29543 ts_tablet_manager.cc:1397] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260809 06:36:35.882694 29546 log.cc:824] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:35.885553 29546 tablet_bootstrap.cc:492] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: No bootstrap required, opened a new log
I20260809 06:36:35.885859 29546 ts_tablet_manager.cc:1397] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260809 06:36:35.885638 29541 raft_consensus.cc:348] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } }
I20260809 06:36:35.886024 29541 raft_consensus.cc:374] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:35.886122 29541 raft_consensus.cc:729] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40927feed6f54c3aa2d6dceaca379685, State: Initialized, Role: FOLLOWER
I20260809 06:36:35.886852 29541 consensus_queue.cc:260] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } }
I20260809 06:36:35.890429 29519 heartbeater.cc:503] Master 127.30.78.126:44541 was elected leader, sending a full tablet report...
I20260809 06:36:35.890900 29541 ts_tablet_manager.cc:1428] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: Time spent starting tablet: real 0.014s user 0.006s sys 0.008s
I20260809 06:36:35.891415 29543 raft_consensus.cc:348] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } }
I20260809 06:36:35.891810 29543 raft_consensus.cc:374] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:35.891917 29543 raft_consensus.cc:729] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fef7d2cedb1e4605936040795c9125b1, State: Initialized, Role: FOLLOWER
I20260809 06:36:35.892592 29543 consensus_queue.cc:260] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } }
I20260809 06:36:35.894227 29543 ts_tablet_manager.cc:1428] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: Time spent starting tablet: real 0.012s user 0.004s sys 0.008s
I20260809 06:36:35.895859 29546 raft_consensus.cc:348] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } }
I20260809 06:36:35.896257 29546 raft_consensus.cc:374] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:35.896360 29546 raft_consensus.cc:729] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb1f0a02a2164dbab2c47d0b0a767852, State: Initialized, Role: FOLLOWER
I20260809 06:36:35.897044 29546 consensus_queue.cc:260] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } }
I20260809 06:36:35.898044 29295 heartbeater.cc:503] Master 127.30.78.126:44541 was elected leader, sending a full tablet report...
I20260809 06:36:35.898624 29546 ts_tablet_manager.cc:1428] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260809 06:36:35.945035 29550 raft_consensus.cc:482] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:36:35.945325 29550 raft_consensus.cc:504] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } }
I20260809 06:36:35.946938 29550 leader_election.cc:288] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fef7d2cedb1e4605936040795c9125b1 (127.30.78.65:33371), bb1f0a02a2164dbab2c47d0b0a767852 (127.30.78.66:39153)
I20260809 06:36:35.953236 29540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.947325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:40961 (local address 127.30.78.66:39153)
0809 06:36:35.947536 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:35.947542 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:35.947761 (+ 219us) server_negotiation.cc:407] Connection header received
0809 06:36:35.947976 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:35.947982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:35.948059 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:35.948156 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:35.948544 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.949474 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.951390 (+ 1916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.952491 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.952595 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.952647 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:35.952968 (+ 321us) server_negotiation.cc:299] Negotiation successful
0809 06:36:35.953049 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:36:35.953358 29522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.947368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:39153 (local address 127.30.78.67:40961)
0809 06:36:35.947667 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:35.947687 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:35.947830 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:35.948185 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:35.948189 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:35.948217 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:35.948407 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.948419 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.949595 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.949601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.951237 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.951249 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.952628 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.952634 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.952823 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.952859 (+ 36us) client_negotiation.cc:769] Sending connection context
0809 06:36:35.952956 (+ 97us) client_negotiation.cc:240] Negotiation successful
0809 06:36:35.953088 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":1}
I20260809 06:36:35.954298 29538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.947270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:36517 (local address 127.30.78.65:33371)
0809 06:36:35.947478 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:35.947484 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:35.948320 (+ 836us) server_negotiation.cc:407] Connection header received
0809 06:36:35.948468 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:35.948474 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:35.948552 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:35.948619 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:35.949214 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.950244 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.952238 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.953256 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.953399 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.953469 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:35.953945 (+ 476us) server_negotiation.cc:299] Negotiation successful
0809 06:36:35.954066 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:36:35.954327 29555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:35.947446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:33371 (local address 127.30.78.67:36517)
0809 06:36:35.948213 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:35.948230 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:35.948349 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:35.948661 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:35.948666 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:35.948690 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:35.949048 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.949059 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.950407 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.950412 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.952091 (+ 1679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:35.952107 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:35.953577 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:35.953583 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:35.953778 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:35.953810 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:36:35.953903 (+ 93us) client_negotiation.cc:240] Negotiation successful
0809 06:36:35.954019 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"thread_start_us":417,"threads_started":1}
I20260809 06:36:35.954276 29219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c278e29f36c449a9058921432515a38" candidate_uuid: "40927feed6f54c3aa2d6dceaca379685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" is_pre_election: true
I20260809 06:36:35.954756 29219 raft_consensus.cc:2454] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40927feed6f54c3aa2d6dceaca379685 in term 0.
I20260809 06:36:35.955341 28992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c278e29f36c449a9058921432515a38" candidate_uuid: "40927feed6f54c3aa2d6dceaca379685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef7d2cedb1e4605936040795c9125b1" is_pre_election: true
I20260809 06:36:35.955474 29329 leader_election.cc:302] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40927feed6f54c3aa2d6dceaca379685, bb1f0a02a2164dbab2c47d0b0a767852; no voters:
I20260809 06:36:35.955804 29550 raft_consensus.cc:2781] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:36:35.955819 28992 raft_consensus.cc:2454] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40927feed6f54c3aa2d6dceaca379685 in term 0.
I20260809 06:36:35.955969 29550 raft_consensus.cc:482] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:36:35.956071 29550 raft_consensus.cc:3037] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:35.958343 29550 raft_consensus.cc:504] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } }
I20260809 06:36:35.958853 29550 leader_election.cc:288] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [CANDIDATE]: Term 1 election: Requested vote from peers fef7d2cedb1e4605936040795c9125b1 (127.30.78.65:33371), bb1f0a02a2164dbab2c47d0b0a767852 (127.30.78.66:39153)
I20260809 06:36:35.959278 28992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c278e29f36c449a9058921432515a38" candidate_uuid: "40927feed6f54c3aa2d6dceaca379685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fef7d2cedb1e4605936040795c9125b1"
I20260809 06:36:35.959295 29219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c278e29f36c449a9058921432515a38" candidate_uuid: "40927feed6f54c3aa2d6dceaca379685" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb1f0a02a2164dbab2c47d0b0a767852"
I20260809 06:36:35.959432 28992 raft_consensus.cc:3037] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:35.959458 29219 raft_consensus.cc:3037] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:35.961532 29219 raft_consensus.cc:2454] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40927feed6f54c3aa2d6dceaca379685 in term 1.
I20260809 06:36:35.961550 28992 raft_consensus.cc:2454] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40927feed6f54c3aa2d6dceaca379685 in term 1.
I20260809 06:36:35.961943 29325 leader_election.cc:302] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40927feed6f54c3aa2d6dceaca379685, fef7d2cedb1e4605936040795c9125b1; no voters:
I20260809 06:36:35.962232 29550 raft_consensus.cc:2781] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:35.962636 29550 raft_consensus.cc:686] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 1 LEADER]: Becoming Leader. State: Replica: 40927feed6f54c3aa2d6dceaca379685, State: Running, Role: LEADER
I20260809 06:36:35.963124 29550 consensus_queue.cc:237] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } }
I20260809 06:36:35.967392 28763 catalog_manager.cc:5495] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40927feed6f54c3aa2d6dceaca379685 (127.30.78.67). New cstate: current_term: 1 leader_uuid: "40927feed6f54c3aa2d6dceaca379685" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40927feed6f54c3aa2d6dceaca379685" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 38233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 } health_report { overall_health: UNKNOWN } } }
I20260809 06:36:36.009794 29536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:36.004718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34422 (local address 127.30.78.67:38233)
0809 06:36:36.004906 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:36.004911 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:36.005004 (+ 93us) server_negotiation.cc:407] Connection header received
0809 06:36:36.005179 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:36.005183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:36.005274 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:36.005414 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:36:36.005691 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:36.006464 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:36.007796 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:36.008249 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:36.008340 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:36.008804 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:36:36.009317 (+ 513us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:36:36.009433 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:36.009505 (+ 72us) server_negotiation.cc:299] Negotiation successful
0809 06:36:36.009568 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 06:36:36.015905 29521 tablet.cc:2369] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260809 06:36:36.015992 29297 tablet.cc:2369] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:36:36.017483 29219 raft_consensus.cc:1261] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [term 1 FOLLOWER]: Refusing update from remote peer 40927feed6f54c3aa2d6dceaca379685: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:36.017674 28992 raft_consensus.cc:1261] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [term 1 FOLLOWER]: Refusing update from remote peer 40927feed6f54c3aa2d6dceaca379685: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:36.018389 29550 consensus_queue.cc:1035] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb1f0a02a2164dbab2c47d0b0a767852" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 39153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:36.018692 29557 consensus_queue.cc:1035] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fef7d2cedb1e4605936040795c9125b1" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260809 06:36:36.022483 29073 tablet.cc:2369] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:36:36.042117 28763 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:36.042392 28763 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:36.046298 28763 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 42234fe844c24dd2ad1d0bc6dd0e5385: Sending DeleteTablet for 3 replicas of tablet 6c278e29f36c449a9058921432515a38
I20260809 06:36:36.047664 29406 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c278e29f36c449a9058921432515a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:36 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:34414
I20260809 06:36:36.047948 29187 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c278e29f36c449a9058921432515a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:36 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:56494
I20260809 06:36:36.048276 28966 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c278e29f36c449a9058921432515a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:36 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:40634
I20260809 06:36:36.048828 28964 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c278e29f36c449a9058921432515a38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:36 UTC) from {username='kudu', principal='kudu/127.30.78.126@KRBTEST.COM'} at 127.0.0.1:40634
I20260809 06:36:36.050441 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 28863
I20260809 06:36:36.064319 29584 tablet_replica.cc:330] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: stopping tablet replica
I20260809 06:36:36.064774 29584 raft_consensus.cc:2229] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:36:36.065003 29586 tablet_replica.cc:330] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: stopping tablet replica
I20260809 06:36:36.065387 29584 raft_consensus.cc:2258] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:36.065369 29586 raft_consensus.cc:2229] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:36.065857 29586 raft_consensus.cc:2258] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:36.067509 29584 ts_tablet_manager.cc:1905] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:36.070372 29585 tablet_replica.cc:330] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: stopping tablet replica
I20260809 06:36:36.070820 29585 raft_consensus.cc:2229] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:36.071375 29585 raft_consensus.cc:2258] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:36.071915 29586 ts_tablet_manager.cc:1905] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:36.074820 29584 ts_tablet_manager.cc:1918] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:36.074980 29584 log.cc:1196] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/6c278e29f36c449a9058921432515a38
I20260809 06:36:36.075551 29584 ts_tablet_manager.cc:1939] T 6c278e29f36c449a9058921432515a38 P 40927feed6f54c3aa2d6dceaca379685: Deleting consensus metadata
I20260809 06:36:36.077323 28740 catalog_manager.cc:4841] TS 40927feed6f54c3aa2d6dceaca379685 (127.30.78.67:38233): tablet 6c278e29f36c449a9058921432515a38 (table test-table [id=27425c19a5784df9b96ffbef73cad078]) successfully deleted
I20260809 06:36:36.079270 29586 ts_tablet_manager.cc:1918] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:36.079444 29586 log.cc:1196] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-0/wal/wals/6c278e29f36c449a9058921432515a38
Aug 09 06:36:36 dist-test-slave-cvwc krb5kdc[28692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.65@KRBTEST.COM
I20260809 06:36:36.079972 29586 ts_tablet_manager.cc:1939] T 6c278e29f36c449a9058921432515a38 P fef7d2cedb1e4605936040795c9125b1: Deleting consensus metadata
I20260809 06:36:36.080993 29585 ts_tablet_manager.cc:1905] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:36.081990 28736 catalog_manager.cc:4841] TS fef7d2cedb1e4605936040795c9125b1 (127.30.78.65:33371): tablet 6c278e29f36c449a9058921432515a38 (table test-table [id=27425c19a5784df9b96ffbef73cad078]) successfully deleted
W20260809 06:36:36.082466 28736 catalog_manager.cc:4808] TS fef7d2cedb1e4605936040795c9125b1 (127.30.78.65:33371): delete failed for tablet 6c278e29f36c449a9058921432515a38 because the tablet was not found. No further retry: Not found: Tablet not found: 6c278e29f36c449a9058921432515a38
I20260809 06:36:36.088012 29538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:36.052813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40646 (local address 127.30.78.65:33371)
0809 06:36:36.053005 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:36.053012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:36.064413 (+ 11401us) server_negotiation.cc:407] Connection header received
0809 06:36:36.069896 (+ 5483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:36.069901 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:36.069991 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:36.070094 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:36.072260 (+ 2166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:36.073398 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:36.075329 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:36.075937 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:36.076057 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:36.080971 (+ 4914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:36.080986 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:36.081002 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:36.081055 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:36.084652 (+ 3597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:36.085473 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:36.085482 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:36.085485 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:36.085641 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:36.086139 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:36.086144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:36.086148 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:36.086575 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:36.086844 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:36.087442 (+ 598us) server_negotiation.cc:299] Negotiation successful
0809 06:36:36.087661 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260809 06:36:36.088788 29585 ts_tablet_manager.cc:1918] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:36.088944 29585 log.cc:1196] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/6c278e29f36c449a9058921432515a38
I20260809 06:36:36.089398 29585 ts_tablet_manager.cc:1939] T 6c278e29f36c449a9058921432515a38 P bb1f0a02a2164dbab2c47d0b0a767852: Deleting consensus metadata
I20260809 06:36:36.089406 29061 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:36.091157 28740 catalog_manager.cc:4841] TS bb1f0a02a2164dbab2c47d0b0a767852 (127.30.78.66:39153): tablet 6c278e29f36c449a9058921432515a38 (table test-table [id=27425c19a5784df9b96ffbef73cad078]) successfully deleted
I20260809 06:36:36.175609 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 28863
I20260809 06:36:36.204385 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 29082
Aug 09 06:36:36 dist-test-slave-cvwc krb5kdc[28692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.66@KRBTEST.COM
I20260809 06:36:36.221549 29540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:36.205256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56510 (local address 127.30.78.66:39153)
0809 06:36:36.205446 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:36.205451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:36.205472 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:36:36.205537 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:36.205543 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:36.205606 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:36.205703 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:36.206964 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:36.207799 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:36.209177 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:36.209590 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:36.209701 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:36.214972 (+ 5271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:36.214989 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:36.215010 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:36.215048 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:36.218611 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:36.219436 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:36.219445 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:36.219449 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:36.219593 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:36.219962 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:36.219966 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:36.219970 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:36.220421 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:36.220710 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:36.220989 (+ 279us) server_negotiation.cc:299] Negotiation successful
0809 06:36:36.221196 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:36:36.222339 29281 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:36.311791 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 29082
I20260809 06:36:36.335386 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 29301
Aug 09 06:36:36 dist-test-slave-cvwc krb5kdc[28692](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257393, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.67@KRBTEST.COM
I20260809 06:36:36.353788 29536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:36.336221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34426 (local address 127.30.78.67:38233)
0809 06:36:36.336404 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:36.336408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:36.336429 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:36:36.336641 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:36.336645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:36.336737 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:36.336836 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:36.338768 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:36.339646 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:36.341430 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:36.341964 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:36.342076 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:36.347666 (+ 5590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:36.347679 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:36.347694 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:36.347752 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:36.350888 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:36.351739 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:36.351748 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:36.351752 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:36.351928 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:36.352336 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:36.352339 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:36.352341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:36.352687 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:36.352932 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:36.353250 (+ 318us) server_negotiation.cc:299] Negotiation successful
0809 06:36:36.353455 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:36:36.354480 29509 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:36.474491 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 29301
I20260809 06:36:36.496898 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 28711
I20260809 06:36:36.497962 28814 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:36.605638 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 28711
2026-08-09T06:36:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4269 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-09T06:36:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:36Z Disabled control of system clock
I20260809 06:36:36.687695 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:35185
--webserver_interface=127.30.78.126
--webserver_port=0
--builtin_ntp_servers=127.30.78.84:40949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:35185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:36:37.005452 29602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:37.005748 29602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:37.005838 29602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:37.013108 29602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:37.013203 29602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:37.013247 29602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:37.013302 29602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:37.013343 29602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:37.022090 29602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:35185
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:35185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:37.023224 29602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:37.024860 29602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:37.035527 29618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:37.035534 29614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:37.035573 29615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:37.036262 29602 server_base.cc:1034] running on GCE node
I20260809 06:36:37.036940 29602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:37.038206 29602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:37.039418 29602 hybrid_clock.cc:648] HybridClock initialized: now 1786257397039348 us; error 50 us; skew 500 ppm
I20260809 06:36:37.039805 29602 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:37.042361 29602 webserver.cc:460] Webserver started at http://127.30.78.126:35855/ using document root <none> and password file <none>
I20260809 06:36:37.043028 29602 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:37.043123 29602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:37.043426 29602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:37.046236 29602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "61ed96c6113848fda14dc5793473f316"
format_stamp: "Formatted at 2026-08-09 06:36:37 on dist-test-slave-cvwc"
server_key: "fe08e25db19c112cf0f480e3275e48c4"
server_key_iv: "9ad6cc2d524b29f6e9a00df2ee6f3dd9"
server_key_version: "encryptionkey@0"
I20260809 06:36:37.046993 29602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "61ed96c6113848fda14dc5793473f316"
format_stamp: "Formatted at 2026-08-09 06:36:37 on dist-test-slave-cvwc"
server_key: "fe08e25db19c112cf0f480e3275e48c4"
server_key_iv: "9ad6cc2d524b29f6e9a00df2ee6f3dd9"
server_key_version: "encryptionkey@0"
I20260809 06:36:37.051704 29602 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:36:37.054842 29628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:37.056016 29602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:37.056171 29602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "61ed96c6113848fda14dc5793473f316"
format_stamp: "Formatted at 2026-08-09 06:36:37 on dist-test-slave-cvwc"
server_key: "fe08e25db19c112cf0f480e3275e48c4"
server_key_iv: "9ad6cc2d524b29f6e9a00df2ee6f3dd9"
server_key_version: "encryptionkey@0"
I20260809 06:36:37.056354 29602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:37.070854 29602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:37.071587 29602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:37.071844 29602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:37.088357 29602 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:35185
I20260809 06:36:37.088394 29698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:35185 every 8 connection(s)
I20260809 06:36:37.089568 29602 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:37.092975 29699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:37.098608 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 29602
I20260809 06:36:37.098764 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:37.099181 31033 external_mini_cluster.cc:1428] Setting key d422c8779bb63b06dadeaac90d7462ee
I20260809 06:36:37.103015 29699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316: Bootstrap starting.
I20260809 06:36:37.106233 29699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:37.107420 29699 log.cc:824] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:37.110463 29699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316: No bootstrap required, opened a new log
I20260809 06:36:37.112174 29702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:37.100919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46432 (local address 127.30.78.126:35185)
0809 06:36:37.101884 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:37.101902 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:37.101943 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:36:37.103591 (+ 1648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:37.103612 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:37.103998 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:37.104289 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:37.104873 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:37.106118 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:37.107936 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:37.108894 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:37.109015 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:37.110123 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:37.110130 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:37.110142 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:37.110652 (+ 510us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:37.110725 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:37.110745 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:37.110835 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:37.111043 (+ 208us) server_negotiation.cc:299] Negotiation successful
0809 06:36:37.111310 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":317,"threads_started":1}
I20260809 06:36:37.117607 29699 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ed96c6113848fda14dc5793473f316" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35185 } }
I20260809 06:36:37.117980 29699 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:37.118076 29699 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61ed96c6113848fda14dc5793473f316, State: Initialized, Role: FOLLOWER
I20260809 06:36:37.118577 29699 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ed96c6113848fda14dc5793473f316" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35185 } }
I20260809 06:36:37.118786 29699 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:37.118921 29699 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:37.119066 29699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:37.121068 29699 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ed96c6113848fda14dc5793473f316" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35185 } }
I20260809 06:36:37.121510 29699 leader_election.cc:302] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61ed96c6113848fda14dc5793473f316; no voters:
I20260809 06:36:37.122053 29699 leader_election.cc:288] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:37.122179 29705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:37.122836 29705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [term 1 LEADER]: Becoming Leader. State: Replica: 61ed96c6113848fda14dc5793473f316, State: Running, Role: LEADER
I20260809 06:36:37.123342 29705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ed96c6113848fda14dc5793473f316" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35185 } }
I20260809 06:36:37.123993 29699 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:37.125962 29706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61ed96c6113848fda14dc5793473f316" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ed96c6113848fda14dc5793473f316" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35185 } } }
I20260809 06:36:37.126343 29706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:37.127059 29707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61ed96c6113848fda14dc5793473f316. Latest consensus state: current_term: 1 leader_uuid: "61ed96c6113848fda14dc5793473f316" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61ed96c6113848fda14dc5793473f316" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 35185 } } }
I20260809 06:36:37.127336 29707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:37.130900 29718 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:37.135586 29718 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:37.143743 29718 catalog_manager.cc:1347] Generated new cluster ID: 82c99676ebcb4335a9a55ef442188033
I20260809 06:36:37.143833 29718 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:37.152634 29718 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:37.153693 29718 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:37.159466 29718 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316: Generated new TSK 0
I20260809 06:36:37.160315 29718 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:37.171876 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.65:0
--local_ip_for_outbound_sockets=127.30.78.65
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35185
--builtin_ntp_servers=127.30.78.84:40949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260809 06:36:37.495251 29740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:37.495509 29740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:37.495600 29740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:37.502662 29740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:37.502758 29740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:37.502866 29740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.65
I20260809 06:36:37.511726 29740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.78.65
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.65
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:37.512830 29740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:37.514524 29740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:37.526548 29747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:37.526616 29755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:37.526641 29749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:37.527561 29740 server_base.cc:1034] running on GCE node
I20260809 06:36:37.528095 29740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:37.528913 29740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:37.530094 29740 hybrid_clock.cc:648] HybridClock initialized: now 1786257397530048 us; error 37 us; skew 500 ppm
I20260809 06:36:37.530372 29740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:37.532454 29740 webserver.cc:460] Webserver started at http://127.30.78.65:43047/ using document root <none> and password file <none>
I20260809 06:36:37.533063 29740 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:37.533157 29740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:37.533442 29740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:37.536104 29740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/data/instance:
uuid: "dd3cc63c46394ab79c90f0ed2e486f78"
format_stamp: "Formatted at 2026-08-09 06:36:37 on dist-test-slave-cvwc"
server_key: "dc670df716b0ec30fc51e8253b7fddbb"
server_key_iv: "9e67f44cb1d6226aae3c736bbd1b217c"
server_key_version: "encryptionkey@0"
I20260809 06:36:37.536840 29740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance:
uuid: "dd3cc63c46394ab79c90f0ed2e486f78"
format_stamp: "Formatted at 2026-08-09 06:36:37 on dist-test-slave-cvwc"
server_key: "dc670df716b0ec30fc51e8253b7fddbb"
server_key_iv: "9e67f44cb1d6226aae3c736bbd1b217c"
server_key_version: "encryptionkey@0"
I20260809 06:36:37.541451 29740 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260809 06:36:37.544569 29765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:37.545691 29740 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:37.545886 29740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/wal
uuid: "dd3cc63c46394ab79c90f0ed2e486f78"
format_stamp: "Formatted at 2026-08-09 06:36:37 on dist-test-slave-cvwc"
server_key: "dc670df716b0ec30fc51e8253b7fddbb"
server_key_iv: "9e67f44cb1d6226aae3c736bbd1b217c"
server_key_version: "encryptionkey@0"
I20260809 06:36:37.546067 29740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:37.576841 29740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:37.577584 29740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:37.577872 29740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:37.578763 29740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:37.580125 29740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:37.580215 29740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:37.580318 29740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:37.580397 29740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:37.609939 29740 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.65:37767
I20260809 06:36:37.610010 29950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.65:37767 every 8 connection(s)
I20260809 06:36:37.611166 29740 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/data/info.pb
I20260809 06:36:37.618827 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 29740
I20260809 06:36:37.618983 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-0/wal/instance
I20260809 06:36:37.619581 31033 external_mini_cluster.cc:1428] Setting key f64d27dd3c9ac61ad67bc20f1155f791
I20260809 06:36:37.622342 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.66:0
--local_ip_for_outbound_sockets=127.30.78.66
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35185
--builtin_ntp_servers=127.30.78.84:40949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:36:37.623557 29954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:37.613672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.65:57549 (local address 127.30.78.126:35185)
0809 06:36:37.614115 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:37.614119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:37.615165 (+ 1046us) server_negotiation.cc:407] Connection header received
0809 06:36:37.616898 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:37.616904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:37.616984 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:37.617081 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:37.618159 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:37.618922 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:37.620896 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:37.621368 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:37.621461 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:37.622783 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:37.622789 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:37.622793 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:37.622821 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:37.622871 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:37.622886 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:37.622964 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:37.623143 (+ 179us) server_negotiation.cc:299] Negotiation successful
0809 06:36:37.623233 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":244,"threads_started":1}
I20260809 06:36:37.624369 29955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:37.614171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:35185 (local address 127.30.78.65:57549)
0809 06:36:37.615018 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:37.615054 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:37.616633 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:37.617311 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:37.617327 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:37.617409 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:37.617995 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:37.618012 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:37.619098 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:37.619104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:37.620761 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:37.620776 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:37.621576 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:37.621582 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:37.621832 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:37.622462 (+ 630us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:36:37.622466 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:37.622520 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:36:37.622598 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:37.622973 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:37.622978 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:37.622983 (+ 5us) client_negotiation.cc:769] Sending connection context
0809 06:36:37.623101 (+ 118us) client_negotiation.cc:240] Negotiation successful
0809 06:36:37.623363 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":256,"threads_started":1}
I20260809 06:36:37.625794 29952 heartbeater.cc:347] Connected to a master server at 127.30.78.126:35185
I20260809 06:36:37.626089 29952 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:37.626892 29952 heartbeater.cc:511] Master 127.30.78.126:35185 requested a full tablet report, sending...
I20260809 06:36:37.628888 29654 ts_manager.cc:194] Registered new tserver with Master: dd3cc63c46394ab79c90f0ed2e486f78 (127.30.78.65:37767)
I20260809 06:36:37.630362 29654 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.65:57549
W20260809 06:36:37.944233 29957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:37.944515 29957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:37.944615 29957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:37.951877 29957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:37.951973 29957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:37.952091 29957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.66
I20260809 06:36:37.960901 29957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.78.66
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.66
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:37.962123 29957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:37.963835 29957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:37.976410 29968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:37.976524 29966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:37.976533 29964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:37.977413 29957 server_base.cc:1034] running on GCE node
I20260809 06:36:37.978049 29957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:37.978941 29957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:37.980147 29957 hybrid_clock.cc:648] HybridClock initialized: now 1786257397980103 us; error 36 us; skew 500 ppm
I20260809 06:36:37.980455 29957 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:37.982609 29957 webserver.cc:460] Webserver started at http://127.30.78.66:34371/ using document root <none> and password file <none>
I20260809 06:36:37.983254 29957 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:37.983353 29957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:37.983668 29957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:37.986596 29957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/data/instance:
uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7"
format_stamp: "Formatted at 2026-08-09 06:36:37 on dist-test-slave-cvwc"
server_key: "ea61574bdc06e511f27b39b342c0ec75"
server_key_iv: "105c62cc993ba488f056dcf5c40c47d9"
server_key_version: "encryptionkey@0"
I20260809 06:36:37.987355 29957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance:
uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7"
format_stamp: "Formatted at 2026-08-09 06:36:37 on dist-test-slave-cvwc"
server_key: "ea61574bdc06e511f27b39b342c0ec75"
server_key_iv: "105c62cc993ba488f056dcf5c40c47d9"
server_key_version: "encryptionkey@0"
I20260809 06:36:37.992274 29957 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260809 06:36:37.995589 29978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:37.996796 29957 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:36:37.996948 29957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/wal
uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7"
format_stamp: "Formatted at 2026-08-09 06:36:37 on dist-test-slave-cvwc"
server_key: "ea61574bdc06e511f27b39b342c0ec75"
server_key_iv: "105c62cc993ba488f056dcf5c40c47d9"
server_key_version: "encryptionkey@0"
I20260809 06:36:37.997138 29957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:38.012120 29957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:38.012873 29957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:38.013142 29957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:38.014073 29957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:38.015411 29957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:38.015518 29957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:38.015622 29957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:38.015691 29957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:38.057263 29957 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.66:35699
I20260809 06:36:38.057308 30162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.66:35699 every 8 connection(s)
I20260809 06:36:38.058615 29957 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/data/info.pb
I20260809 06:36:38.060490 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 29957
I20260809 06:36:38.060647 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/wal/instance
I20260809 06:36:38.061148 31033 external_mini_cluster.cc:1428] Setting key c04b7d61f62ccf3bd851139968eac65f
I20260809 06:36:38.064018 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.78.67:0
--local_ip_for_outbound_sockets=127.30.78.67
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35185
--builtin_ntp_servers=127.30.78.84:40949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260809 06:36:38.071022 29954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.061168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.66:57099 (local address 127.30.78.126:35185)
0809 06:36:38.061370 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.061377 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.062831 (+ 1454us) server_negotiation.cc:407] Connection header received
0809 06:36:38.064701 (+ 1870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.064707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.064785 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.064871 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:38.065960 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.066650 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.068333 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.068745 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.068857 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.070231 (+ 1374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:38.070236 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:38.070239 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:38.070258 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:38.070290 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:38.070302 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:38.070377 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.070601 (+ 224us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.070705 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260809 06:36:38.072005 30167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.061726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:35185 (local address 127.30.78.66:57099)
0809 06:36:38.062681 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.062721 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:38.064448 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:38.065115 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:38.065123 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:38.065208 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:38.065801 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.065821 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.066807 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.066812 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.068194 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.068208 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.068976 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.068985 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.069203 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.069911 (+ 708us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:36:38.069913 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:38.069971 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:36:38.070048 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:38.070390 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:38.070401 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:38.070409 (+ 8us) client_negotiation.cc:769] Sending connection context
0809 06:36:38.070558 (+ 149us) client_negotiation.cc:240] Negotiation successful
0809 06:36:38.070964 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":323,"threads_started":1}
I20260809 06:36:38.073324 30163 heartbeater.cc:347] Connected to a master server at 127.30.78.126:35185
I20260809 06:36:38.073639 30163 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:38.074568 30163 heartbeater.cc:511] Master 127.30.78.126:35185 requested a full tablet report, sending...
I20260809 06:36:38.076139 29654 ts_manager.cc:194] Registered new tserver with Master: a5d1f6c4d19f4c74b59e8a7c264b17c7 (127.30.78.66:35699)
I20260809 06:36:38.077198 29654 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.66:57099
W20260809 06:36:38.392474 30168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:38.392727 30168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:38.392828 30168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:38.399793 30168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:38.399883 30168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:38.399988 30168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.78.67
I20260809 06:36:38.408648 30168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.78.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.78.67
--webserver_port=0
--tserver_master_addrs=127.30.78.126:35185
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.78.67
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:38.409782 30168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:38.411420 30168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:38.423318 30175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:38.423355 30176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:38.423401 30179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:38.424345 30168 server_base.cc:1034] running on GCE node
I20260809 06:36:38.424921 30168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:38.425757 30168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:38.426952 30168 hybrid_clock.cc:648] HybridClock initialized: now 1786257398426902 us; error 45 us; skew 500 ppm
I20260809 06:36:38.427222 30168 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260809 06:36:38.429214 30168 webserver.cc:460] Webserver started at http://127.30.78.67:34305/ using document root <none> and password file <none>
I20260809 06:36:38.429872 30168 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:38.429968 30168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:38.430270 30168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:38.433063 30168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/data/instance:
uuid: "c3ffe34f11104e459515a7f09dd28fff"
format_stamp: "Formatted at 2026-08-09 06:36:38 on dist-test-slave-cvwc"
server_key: "03769a6a916d6ca56a57c06e0e50f1d8"
server_key_iv: "4df31beb3250e3c049ee7f17782e7bc4"
server_key_version: "encryptionkey@0"
I20260809 06:36:38.433846 30168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance:
uuid: "c3ffe34f11104e459515a7f09dd28fff"
format_stamp: "Formatted at 2026-08-09 06:36:38 on dist-test-slave-cvwc"
server_key: "03769a6a916d6ca56a57c06e0e50f1d8"
server_key_iv: "4df31beb3250e3c049ee7f17782e7bc4"
server_key_version: "encryptionkey@0"
I20260809 06:36:38.438407 30168 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260809 06:36:38.441499 30194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:38.442704 30168 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 06:36:38.442859 30168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/wal
uuid: "c3ffe34f11104e459515a7f09dd28fff"
format_stamp: "Formatted at 2026-08-09 06:36:38 on dist-test-slave-cvwc"
server_key: "03769a6a916d6ca56a57c06e0e50f1d8"
server_key_iv: "4df31beb3250e3c049ee7f17782e7bc4"
server_key_version: "encryptionkey@0"
I20260809 06:36:38.443046 30168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:38.469480 30168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:38.470264 30168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:38.470531 30168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:38.471431 30168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260809 06:36:38.472820 30168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260809 06:36:38.472913 30168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:38.473017 30168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260809 06:36:38.473085 30168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:38.501864 30168 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.67:36627
I20260809 06:36:38.501932 30375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.67:36627 every 8 connection(s)
I20260809 06:36:38.503180 30168 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/data/info.pb
I20260809 06:36:38.512357 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 30168
I20260809 06:36:38.512535 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/wal/instance
I20260809 06:36:38.513094 31033 external_mini_cluster.cc:1428] Setting key 295cb040bb47468f407dea44247adbf2
I20260809 06:36:38.515304 29954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.505603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:50993 (local address 127.30.78.126:35185)
0809 06:36:38.505837 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.505842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.507209 (+ 1367us) server_negotiation.cc:407] Connection header received
0809 06:36:38.508894 (+ 1685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.508897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.508966 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.509048 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:38.510096 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.510824 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.512360 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.512948 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.513070 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.514463 (+ 1393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:38.514468 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:38.514472 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:38.514492 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:38.514528 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:38.514544 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:38.514630 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.514869 (+ 239us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.514963 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:36:38.516305 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.506107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:35185 (local address 127.30.78.67:50993)
0809 06:36:38.507065 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.507107 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:38.508670 (+ 1563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:38.509240 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:38.509247 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:38.509328 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:36:38.509926 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.509946 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.510998 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.511002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.512216 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.512229 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.513146 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.513152 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.513380 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.514129 (+ 749us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0809 06:36:38.514132 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:36:38.514189 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0809 06:36:38.514284 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:36:38.514632 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:36:38.514641 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:36:38.514648 (+ 7us) client_negotiation.cc:769] Sending connection context
0809 06:36:38.514842 (+ 194us) client_negotiation.cc:240] Negotiation successful
0809 06:36:38.515196 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":261,"threads_started":1}
I20260809 06:36:38.517452 30377 heartbeater.cc:347] Connected to a master server at 127.30.78.126:35185
I20260809 06:36:38.517741 30377 heartbeater.cc:464] Registering TS with master...
I20260809 06:36:38.518421 30377 heartbeater.cc:511] Master 127.30.78.126:35185 requested a full tablet report, sending...
I20260809 06:36:38.519654 29654 ts_manager.cc:194] Registered new tserver with Master: c3ffe34f11104e459515a7f09dd28fff (127.30.78.67:36627)
I20260809 06:36:38.520407 29654 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.78.67:50993
I20260809 06:36:38.527629 31033 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260809 06:36:38.536494 29954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.531418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46436 (local address 127.30.78.126:35185)
0809 06:36:38.531619 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.531626 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.531988 (+ 362us) server_negotiation.cc:407] Connection header received
0809 06:36:38.532123 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.532126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.532191 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.532260 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:38.532652 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.533311 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.534641 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.535029 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.535116 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.535928 (+ 812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:38.535932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:38.535935 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:38.535952 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:38.535980 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:38.535991 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:38.536051 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.536138 (+ 87us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.536212 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260809 06:36:38.539743 29654 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260809 06:36:38.546358 29654 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260809 06:36:38.577440 30398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.557977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.0.0.1:55382)
0809 06:36:38.568795 (+ 10818us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.568816 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:38.568964 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:38.570231 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:38.570239 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:38.570273 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:38.570747 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.570762 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.572765 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.572770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.574737 (+ 1967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.574750 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.576530 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.576537 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.576730 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.576785 (+ 55us) client_negotiation.cc:769] Sending connection context
0809 06:36:38.576909 (+ 124us) client_negotiation.cc:240] Negotiation successful
0809 06:36:38.577090 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10390,"mutex_wait_us":19,"thread_start_us":10586,"threads_started":1}
I20260809 06:36:38.578450 30396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.557513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:35699 (local address 127.0.0.1:42462)
0809 06:36:38.558356 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.558395 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:38.558581 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:38.572011 (+ 13430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:38.572016 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:38.572040 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:38.572363 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.572384 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.574118 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.574121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.575909 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.575924 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.577678 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.577684 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.577914 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.577946 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:36:38.578031 (+ 85us) client_negotiation.cc:240] Negotiation successful
0809 06:36:38.578163 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":475,"threads_started":1}
I20260809 06:36:38.578824 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.559585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.67:36627 (local address 127.0.0.1:57094)
0809 06:36:38.570284 (+ 10699us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.570302 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:38.570429 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:38.571378 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:38.571383 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:38.571432 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:38.571749 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.571768 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.573609 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.573614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.576324 (+ 2710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.576339 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.578079 (+ 1740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.578085 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.578246 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.578278 (+ 32us) client_negotiation.cc:769] Sending connection context
0809 06:36:38.578362 (+ 84us) client_negotiation.cc:240] Negotiation successful
0809 06:36:38.578505 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10583,"mutex_wait_us":2,"thread_start_us":10449,"threads_started":1}
I20260809 06:36:38.578961 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.559134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57094 (local address 127.30.78.67:36627)
0809 06:36:38.569881 (+ 10747us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.569888 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.570561 (+ 673us) server_negotiation.cc:407] Connection header received
0809 06:36:38.570670 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.570677 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.570893 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.571071 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:38.571960 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.573438 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.576505 (+ 3067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.577862 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.577987 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.578241 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.578435 (+ 194us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.578620 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10547,"thread_start_us":10386,"threads_started":1}
I20260809 06:36:38.579180 30399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.558801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55382 (local address 127.30.78.65:37767)
0809 06:36:38.569442 (+ 10641us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.569452 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.569484 (+ 32us) server_negotiation.cc:407] Connection header received
0809 06:36:38.569585 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.569594 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.569968 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.570957 (+ 989us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:38.571185 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.572624 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.574937 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.576326 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.578195 (+ 1869us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.578421 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.578499 (+ 78us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.578851 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10496,"thread_start_us":10386,"threads_started":1}
I20260809 06:36:38.579293 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.557702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42462 (local address 127.30.78.66:35699)
0809 06:36:38.571435 (+ 13733us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.571443 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.571471 (+ 28us) server_negotiation.cc:407] Connection header received
0809 06:36:38.571577 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.571584 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.571790 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.572019 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:38.572539 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.574005 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.576116 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.577465 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.577650 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.577935 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.578788 (+ 853us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.578976 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13555,"thread_start_us":13428,"threads_started":1}
I20260809 06:36:38.582684 29842 tablet_service.cc:1467] Processing CreateTablet for tablet 4adcecd6044c4661a16349722be8edc3 (DEFAULT_TABLE table=test-table [id=90f194d62e3f40b69ad172c70b1d7ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:38.582764 30265 tablet_service.cc:1467] Processing CreateTablet for tablet 4adcecd6044c4661a16349722be8edc3 (DEFAULT_TABLE table=test-table [id=90f194d62e3f40b69ad172c70b1d7ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:38.582764 30055 tablet_service.cc:1467] Processing CreateTablet for tablet 4adcecd6044c4661a16349722be8edc3 (DEFAULT_TABLE table=test-table [id=90f194d62e3f40b69ad172c70b1d7ee5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260809 06:36:38.583892 29842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adcecd6044c4661a16349722be8edc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:38.584079 30055 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adcecd6044c4661a16349722be8edc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:38.584079 30265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4adcecd6044c4661a16349722be8edc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:38.594648 30404 tablet_bootstrap.cc:492] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78: Bootstrap starting.
I20260809 06:36:38.597693 30405 tablet_bootstrap.cc:492] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: Bootstrap starting.
I20260809 06:36:38.597925 30404 tablet_bootstrap.cc:654] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:38.598585 30407 tablet_bootstrap.cc:492] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: Bootstrap starting.
I20260809 06:36:38.599519 30404 log.cc:824] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:38.601856 30405 tablet_bootstrap.cc:654] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:38.602048 30407 tablet_bootstrap.cc:654] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:38.602725 30404 tablet_bootstrap.cc:492] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78: No bootstrap required, opened a new log
I20260809 06:36:38.602970 30407 log.cc:824] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:38.603008 30404 ts_tablet_manager.cc:1397] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.005s
I20260809 06:36:38.603030 30405 log.cc:824] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:38.605504 30405 tablet_bootstrap.cc:492] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: No bootstrap required, opened a new log
I20260809 06:36:38.605753 30405 ts_tablet_manager.cc:1397] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.005s
I20260809 06:36:38.605769 30407 tablet_bootstrap.cc:492] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: No bootstrap required, opened a new log
I20260809 06:36:38.605994 30407 ts_tablet_manager.cc:1397] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.004s
I20260809 06:36:38.613103 30404 raft_consensus.cc:348] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } }
I20260809 06:36:38.613619 30404 raft_consensus.cc:374] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:38.613782 30404 raft_consensus.cc:729] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd3cc63c46394ab79c90f0ed2e486f78, State: Initialized, Role: FOLLOWER
I20260809 06:36:38.613622 30405 raft_consensus.cc:348] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } }
I20260809 06:36:38.614068 30405 raft_consensus.cc:374] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:38.614198 30405 raft_consensus.cc:729] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ffe34f11104e459515a7f09dd28fff, State: Initialized, Role: FOLLOWER
I20260809 06:36:38.614575 30404 consensus_queue.cc:260] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } }
I20260809 06:36:38.614909 30405 consensus_queue.cc:260] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } }
I20260809 06:36:38.615818 30407 raft_consensus.cc:348] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } }
I20260809 06:36:38.616294 30407 raft_consensus.cc:374] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:38.616446 30407 raft_consensus.cc:729] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5d1f6c4d19f4c74b59e8a7c264b17c7, State: Initialized, Role: FOLLOWER
I20260809 06:36:38.617188 30407 consensus_queue.cc:260] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } }
I20260809 06:36:38.621791 29952 heartbeater.cc:503] Master 127.30.78.126:35185 was elected leader, sending a full tablet report...
I20260809 06:36:38.622738 30404 ts_tablet_manager.cc:1428] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78: Time spent starting tablet: real 0.020s user 0.004s sys 0.015s
I20260809 06:36:38.623554 30377 heartbeater.cc:503] Master 127.30.78.126:35185 was elected leader, sending a full tablet report...
I20260809 06:36:38.624155 30405 ts_tablet_manager.cc:1428] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: Time spent starting tablet: real 0.018s user 0.005s sys 0.012s
I20260809 06:36:38.628180 30163 heartbeater.cc:503] Master 127.30.78.126:35185 was elected leader, sending a full tablet report...
I20260809 06:36:38.628836 30407 ts_tablet_manager.cc:1428] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: Time spent starting tablet: real 0.023s user 0.012s sys 0.005s
I20260809 06:36:38.678184 30416 raft_consensus.cc:482] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260809 06:36:38.678493 30416 raft_consensus.cc:504] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } }
I20260809 06:36:38.680147 30416 leader_election.cc:288] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5d1f6c4d19f4c74b59e8a7c264b17c7 (127.30.78.66:35699), dd3cc63c46394ab79c90f0ed2e486f78 (127.30.78.65:37767)
I20260809 06:36:38.685559 30399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.680671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:37725 (local address 127.30.78.65:37767)
0809 06:36:38.680888 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.680894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.680918 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:36:38.680991 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.680997 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.681084 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.681185 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:38.681647 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.682382 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.683984 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.684711 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.684855 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.684937 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.685190 (+ 253us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.685305 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:36:38.685575 30380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.680400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.30.78.67:37725)
0809 06:36:38.680560 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.680581 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:38.680702 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:38.681220 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:38.681225 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:38.681252 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:38.681498 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.681507 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.682527 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.682531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.683834 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.683846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.684855 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.684861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.685034 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.685058 (+ 24us) client_negotiation.cc:769] Sending connection context
0809 06:36:38.685136 (+ 78us) client_negotiation.cc:240] Negotiation successful
0809 06:36:38.685268 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"spinlock_wait_cycles":25472}
I20260809 06:36:38.686031 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.680608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.78.67:44031 (local address 127.30.78.66:35699)
0809 06:36:38.680796 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.680802 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.681276 (+ 474us) server_negotiation.cc:407] Connection header received
0809 06:36:38.681422 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.681427 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.681484 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.681558 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0809 06:36:38.682103 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.682766 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.684445 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.685165 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.685299 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.685364 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.685634 (+ 270us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.685779 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260809 06:36:38.686075 30419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.680402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.66:35699 (local address 127.30.78.67:44031)
0809 06:36:38.681172 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.681186 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0809 06:36:38.681294 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:36:38.681594 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:36:38.681598 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:36:38.681620 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0809 06:36:38.681955 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.681964 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.682912 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.682916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.684262 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:36:38.684274 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.685324 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.685330 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:36:38.685487 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.685510 (+ 23us) client_negotiation.cc:769] Sending connection context
0809 06:36:38.685593 (+ 83us) client_negotiation.cc:240] Negotiation successful
0809 06:36:38.685703 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":680,"mutex_wait_us":156,"thread_start_us":332,"threads_started":1}
I20260809 06:36:38.686602 29871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adcecd6044c4661a16349722be8edc3" candidate_uuid: "c3ffe34f11104e459515a7f09dd28fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" is_pre_election: true
I20260809 06:36:38.687080 29871 raft_consensus.cc:2454] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3ffe34f11104e459515a7f09dd28fff in term 0.
I20260809 06:36:38.687000 30087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adcecd6044c4661a16349722be8edc3" candidate_uuid: "c3ffe34f11104e459515a7f09dd28fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" is_pre_election: true
I20260809 06:36:38.687418 30087 raft_consensus.cc:2454] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3ffe34f11104e459515a7f09dd28fff in term 0.
I20260809 06:36:38.687666 30198 leader_election.cc:302] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3ffe34f11104e459515a7f09dd28fff, dd3cc63c46394ab79c90f0ed2e486f78; no voters:
I20260809 06:36:38.688010 30416 raft_consensus.cc:2781] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260809 06:36:38.688156 30416 raft_consensus.cc:482] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260809 06:36:38.688254 30416 raft_consensus.cc:3037] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:38.690568 30416 raft_consensus.cc:504] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } }
I20260809 06:36:38.691155 30416 leader_election.cc:288] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [CANDIDATE]: Term 1 election: Requested vote from peers a5d1f6c4d19f4c74b59e8a7c264b17c7 (127.30.78.66:35699), dd3cc63c46394ab79c90f0ed2e486f78 (127.30.78.65:37767)
I20260809 06:36:38.691458 30087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adcecd6044c4661a16349722be8edc3" candidate_uuid: "c3ffe34f11104e459515a7f09dd28fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7"
I20260809 06:36:38.691625 30087 raft_consensus.cc:3037] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:38.691601 29871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adcecd6044c4661a16349722be8edc3" candidate_uuid: "c3ffe34f11104e459515a7f09dd28fff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd3cc63c46394ab79c90f0ed2e486f78"
I20260809 06:36:38.691768 29871 raft_consensus.cc:3037] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:38.693817 30087 raft_consensus.cc:2454] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3ffe34f11104e459515a7f09dd28fff in term 1.
I20260809 06:36:38.693876 29871 raft_consensus.cc:2454] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3ffe34f11104e459515a7f09dd28fff in term 1.
I20260809 06:36:38.694172 30199 leader_election.cc:302] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5d1f6c4d19f4c74b59e8a7c264b17c7, c3ffe34f11104e459515a7f09dd28fff; no voters:
I20260809 06:36:38.694458 30416 raft_consensus.cc:2781] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:38.694847 30416 raft_consensus.cc:686] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 1 LEADER]: Becoming Leader. State: Replica: c3ffe34f11104e459515a7f09dd28fff, State: Running, Role: LEADER
I20260809 06:36:38.695295 30416 consensus_queue.cc:237] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } }
I20260809 06:36:38.699747 29654 catalog_manager.cc:5495] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff reported cstate change: term changed from 0 to 1, leader changed from <none> to c3ffe34f11104e459515a7f09dd28fff (127.30.78.67). New cstate: current_term: 1 leader_uuid: "c3ffe34f11104e459515a7f09dd28fff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3ffe34f11104e459515a7f09dd28fff" member_type: VOTER last_known_addr { host: "127.30.78.67" port: 36627 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 } health_report { overall_health: UNKNOWN } } }
I20260809 06:36:38.729264 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.724606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57098 (local address 127.30.78.67:36627)
0809 06:36:38.724776 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.724780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.724820 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:36:38.725021 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.725024 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.725096 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.725212 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:36:38.725509 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.726264 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.727492 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.727864 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.727956 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.728336 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:36:38.728839 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:36:38.728951 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.729031 (+ 80us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.729090 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260809 06:36:38.736685 29871 raft_consensus.cc:1261] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [term 1 FOLLOWER]: Refusing update from remote peer c3ffe34f11104e459515a7f09dd28fff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:38.736785 30087 raft_consensus.cc:1261] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [term 1 FOLLOWER]: Refusing update from remote peer c3ffe34f11104e459515a7f09dd28fff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:36:38.737645 30420 consensus_queue.cc:1035] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd3cc63c46394ab79c90f0ed2e486f78" member_type: VOTER last_known_addr { host: "127.30.78.65" port: 37767 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:38.738003 30416 consensus_queue.cc:1035] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5d1f6c4d19f4c74b59e8a7c264b17c7" member_type: VOTER last_known_addr { host: "127.30.78.66" port: 35699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:36:38.759539 29654 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:38.759760 29654 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260809 06:36:38.763176 29654 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 61ed96c6113848fda14dc5793473f316: Sending DeleteTablet for 3 replicas of tablet 4adcecd6044c4661a16349722be8edc3
I20260809 06:36:38.764158 30055 tablet_service.cc:1514] Processing DeleteTablet for tablet 4adcecd6044c4661a16349722be8edc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:38 UTC) from {username='slave'} at 127.0.0.1:42462
I20260809 06:36:38.764252 30265 tablet_service.cc:1514] Processing DeleteTablet for tablet 4adcecd6044c4661a16349722be8edc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:38 UTC) from {username='slave'} at 127.0.0.1:57094
I20260809 06:36:38.764405 29842 tablet_service.cc:1514] Processing DeleteTablet for tablet 4adcecd6044c4661a16349722be8edc3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-09 06:36:38 UTC) from {username='slave'} at 127.0.0.1:55382
I20260809 06:36:38.765991 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 29740
I20260809 06:36:38.775553 30443 tablet_replica.cc:330] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: stopping tablet replica
I20260809 06:36:38.776036 30443 raft_consensus.cc:2229] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 1 LEADER]: Raft consensus shutting down.
I20260809 06:36:38.776750 30443 raft_consensus.cc:2258] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:38.777582 30442 tablet_replica.cc:330] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: stopping tablet replica
I20260809 06:36:38.778046 30442 raft_consensus.cc:2229] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:38.778573 30442 raft_consensus.cc:2258] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:38.780983 30443 ts_tablet_manager.cc:1905] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:38.787729 30442 ts_tablet_manager.cc:1905] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:38.788786 30444 tablet_replica.cc:330] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78: stopping tablet replica
I20260809 06:36:38.789227 30444 raft_consensus.cc:2229] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260809 06:36:38.789744 30444 raft_consensus.cc:2258] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260809 06:36:38.790498 30399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.767270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55396 (local address 127.30.78.65:37767)
0809 06:36:38.767441 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.767447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.781842 (+ 14395us) server_negotiation.cc:407] Connection header received
0809 06:36:38.782310 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.782316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.782422 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.782502 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:38.783169 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.784402 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.786364 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.787048 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.787145 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.788692 (+ 1547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:38.788704 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:38.788721 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:38.789461 (+ 740us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:38.789526 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:38.789550 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:38.789634 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.790014 (+ 380us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.790126 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:36:38.791792 29941 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:38.796895 30443 ts_tablet_manager.cc:1918] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:38.797045 30443 log.cc:1196] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-2/wal/wals/4adcecd6044c4661a16349722be8edc3
I20260809 06:36:38.797359 30442 ts_tablet_manager.cc:1918] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260809 06:36:38.797704 30443 ts_tablet_manager.cc:1939] T 4adcecd6044c4661a16349722be8edc3 P c3ffe34f11104e459515a7f09dd28fff: Deleting consensus metadata
I20260809 06:36:38.797806 30442 log.cc:1196] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: Deleting WAL directory at /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786257083636440-31033-0/minicluster-data/ts-1/wal/wals/4adcecd6044c4661a16349722be8edc3
I20260809 06:36:38.798367 30442 ts_tablet_manager.cc:1939] T 4adcecd6044c4661a16349722be8edc3 P a5d1f6c4d19f4c74b59e8a7c264b17c7: Deleting consensus metadata
I20260809 06:36:38.799644 29632 catalog_manager.cc:4841] TS c3ffe34f11104e459515a7f09dd28fff (127.30.78.67:36627): tablet 4adcecd6044c4661a16349722be8edc3 (table test-table [id=90f194d62e3f40b69ad172c70b1d7ee5]) successfully deleted
I20260809 06:36:38.800000 29632 catalog_manager.cc:4841] TS a5d1f6c4d19f4c74b59e8a7c264b17c7 (127.30.78.66:35699): tablet 4adcecd6044c4661a16349722be8edc3 (table test-table [id=90f194d62e3f40b69ad172c70b1d7ee5]) successfully deleted
I20260809 06:36:38.900986 30444 ts_tablet_manager.cc:1905] T 4adcecd6044c4661a16349722be8edc3 P dd3cc63c46394ab79c90f0ed2e486f78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260809 06:36:38.902104 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 29740
I20260809 06:36:38.922780 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 29957
W20260809 06:36:38.922854 29631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.78.65:37767 (error 108)
I20260809 06:36:38.925568 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.925025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.0.0.1:55404)
0809 06:36:38.925218 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.925392 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:37767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260809 06:36:38.925851 29631 catalog_manager.cc:4584] TS dd3cc63c46394ab79c90f0ed2e486f78 (127.30.78.65:37767): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4adcecd6044c4661a16349722be8edc3: Network error: Client connection negotiation failed: client connection to 127.30.78.65:37767: connect: Connection refused (error 111)
I20260809 06:36:38.930414 30397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.923507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42472 (local address 127.30.78.66:35699)
0809 06:36:38.923678 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:38.923684 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:38.923734 (+ 50us) server_negotiation.cc:407] Connection header received
0809 06:36:38.923959 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:38.923965 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:38.924109 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:38.924232 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:38.924802 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.925815 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.927534 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:38.927921 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:38.928011 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:38.929056 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:38.929065 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:38.929079 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:38.929635 (+ 556us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:38.929679 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:38.929699 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:38.929956 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:38.930070 (+ 114us) server_negotiation.cc:299] Negotiation successful
0809 06:36:38.930152 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:36:38.931164 30157 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:38.979722 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.979158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.0.0.1:55410)
0809 06:36:38.979406 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.979522 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:37767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260809 06:36:38.980921 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:38.980506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.0.0.1:55424)
0809 06:36:38.980659 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:38.980768 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:37767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260809 06:36:39.018617 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 29957
I20260809 06:36:39.041294 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:39.040844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.0.0.1:55432)
0809 06:36:39.041038 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:39.041125 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:37767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 06:36:39.042342 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:39.041999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.0.0.1:55442)
0809 06:36:39.042149 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:39.042224 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:37767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260809 06:36:39.050769 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 30168
I20260809 06:36:39.058686 30400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:39.051506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57112 (local address 127.30.78.67:36627)
0809 06:36:39.051969 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:39.051974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:39.051989 (+ 15us) server_negotiation.cc:407] Connection header received
0809 06:36:39.052045 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:39.052049 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:39.052123 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:39.052199 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:39.052769 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:39.053586 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:39.055505 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:39.055928 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:39.056017 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:39.057216 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:39.057225 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:39.057240 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:39.057913 (+ 673us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:39.057962 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:39.057984 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:39.058061 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:39.058256 (+ 195us) server_negotiation.cc:299] Negotiation successful
0809 06:36:39.058335 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355}
I20260809 06:36:39.059495 30369 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:39.123117 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:39.122693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.0.0.1:55450)
0809 06:36:39.122869 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:39.122966 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:37767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 06:36:39.124109 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:39.123752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.0.0.1:55452)
0809 06:36:39.123930 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:39.123997 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:37767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260809 06:36:39.177438 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 30168
I20260809 06:36:39.201702 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 29602
I20260809 06:36:39.202804 29694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:39.307134 30401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:39.306633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.65:37767 (local address 127.0.0.1:55454)
0809 06:36:39.306820 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0809 06:36:39.306942 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.65:37767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260809 06:36:39.307142 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 29602
2026-08-09T06:36:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (2704 ms)
[----------] 6 tests from EncryptionPolicyTest (21580 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:39 dist-test-slave-cvwc krb5kdc[30456](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:39 dist-test-slave-cvwc krb5kdc[30456](info): set up 2 sockets
Aug 09 06:36:39 dist-test-slave-cvwc krb5kdc[30456](info): commencing operation
krb5kdc: starting...
W20260809 06:36:40.523433 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:40 dist-test-slave-cvwc krb5kdc[30456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:40.802757 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43211
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:41.127846 30480 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:41.128114 30480 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:41.128250 30480 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:41.135160 30480 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:41.135267 30480 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:41.135360 30480 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:41.135442 30480 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:41.135501 30480 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:41.144742 30480 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43211
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:41.145921 30480 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:41.147100 30480 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:41.158349 30489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:41.158416 30488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:41.158393 30493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:41.159731 30480 server_base.cc:1034] running on GCE node
I20260809 06:36:41.160485 30480 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:41.161847 30480 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:41.163077 30480 hybrid_clock.cc:648] HybridClock initialized: now 1786257401163030 us; error 38 us; skew 500 ppm
I20260809 06:36:41.163432 30480 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:41 dist-test-slave-cvwc krb5kdc[30456](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257401, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:41.166320 30480 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:41.167707 30480 webserver.cc:460] Webserver started at http://127.0.0.1:43029/ using document root <none> and password file <none>
I20260809 06:36:41.168318 30480 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:41.168442 30480 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:41.168717 30480 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:41.171599 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "6335e652170048edb35baeb28ddef9de"
format_stamp: "Formatted at 2026-08-09 06:36:41 on dist-test-slave-cvwc"
server_key: "bde9385adc31c60986862dcee8fbdbdf"
server_key_iv: "f648e2ca42894d7ce141051c36a586f4"
server_key_version: "encryptionkey@0"
I20260809 06:36:41.172353 30480 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "6335e652170048edb35baeb28ddef9de"
format_stamp: "Formatted at 2026-08-09 06:36:41 on dist-test-slave-cvwc"
server_key: "bde9385adc31c60986862dcee8fbdbdf"
server_key_iv: "f648e2ca42894d7ce141051c36a586f4"
server_key_version: "encryptionkey@0"
I20260809 06:36:41.177181 30480 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:36:41.180464 30503 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:41.181653 30480 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:36:41.181833 30480 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "6335e652170048edb35baeb28ddef9de"
format_stamp: "Formatted at 2026-08-09 06:36:41 on dist-test-slave-cvwc"
server_key: "bde9385adc31c60986862dcee8fbdbdf"
server_key_iv: "f648e2ca42894d7ce141051c36a586f4"
server_key_version: "encryptionkey@0"
I20260809 06:36:41.182014 30480 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:41.200601 30480 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:41.204035 30480 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:41.204272 30480 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:41.220853 30480 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43211
I20260809 06:36:41.220888 30578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43211 every 8 connection(s)
I20260809 06:36:41.222103 30480 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:41.224150 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 30480
I20260809 06:36:41.224325 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:41.224959 31033 external_mini_cluster.cc:1428] Setting key 97c31270f61bec23acac07e4c2d1f1f5
I20260809 06:36:41.225667 30579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:36:41 dist-test-slave-cvwc krb5kdc[30456](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 06:36:41.239128 30579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de: Bootstrap starting.
I20260809 06:36:41.243059 30579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:41.244236 30579 log.cc:824] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:41.247519 30579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de: No bootstrap required, opened a new log
I20260809 06:36:41.247799 30584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:41.226744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35293 (local address 127.0.0.1:43211)
0809 06:36:41.227558 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:41.227572 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:41.227620 (+ 48us) server_negotiation.cc:407] Connection header received
0809 06:36:41.229215 (+ 1595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:41.229242 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:41.229763 (+ 521us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:41.230178 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:41.231395 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:41.233360 (+ 1965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:41.234632 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:41.235613 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:41.235809 (+ 196us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:41.239723 (+ 3914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:41.239733 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:41.239750 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:41.239792 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:41.243476 (+ 3684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:41.244262 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:41.244270 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:41.244278 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:41.244488 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:41.244974 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:41.244981 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:41.244983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:41.245505 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:41.245839 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:41.246198 (+ 359us) server_negotiation.cc:299] Negotiation successful
0809 06:36:41.246531 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":330,"threads_started":1}
I20260809 06:36:41.251439 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:41.255330 30579 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6335e652170048edb35baeb28ddef9de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43211 } }
I20260809 06:36:41.255748 30579 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:41.255872 30579 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6335e652170048edb35baeb28ddef9de, State: Initialized, Role: FOLLOWER
I20260809 06:36:41.256554 30579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6335e652170048edb35baeb28ddef9de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43211 } }
I20260809 06:36:41.256781 30579 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:41.256920 30579 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:41.257079 30579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:41.259248 30579 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6335e652170048edb35baeb28ddef9de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43211 } }
I20260809 06:36:41.259701 30579 leader_election.cc:302] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6335e652170048edb35baeb28ddef9de; no voters:
I20260809 06:36:41.260284 30579 leader_election.cc:288] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:41.260393 30596 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:41.262653 30579 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:41.265992 30596 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [term 1 LEADER]: Becoming Leader. State: Replica: 6335e652170048edb35baeb28ddef9de, State: Running, Role: LEADER
I20260809 06:36:41.266702 30596 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6335e652170048edb35baeb28ddef9de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43211 } }
I20260809 06:36:41.269472 30597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6335e652170048edb35baeb28ddef9de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6335e652170048edb35baeb28ddef9de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43211 } } }
I20260809 06:36:41.269873 30597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:41.270479 30584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:41.255905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42489 (local address 127.0.0.1:43211)
0809 06:36:41.256064 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:41.256070 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:41.256446 (+ 376us) server_negotiation.cc:407] Connection header received
0809 06:36:41.256620 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:41.256623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:41.256678 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:41.256753 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:41.258245 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:41.259011 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:41.260278 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:41.260959 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:41.261097 (+ 138us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:41.263649 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:41.263654 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:41.263657 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:41.263685 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:41.266651 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:41.267439 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:41.267442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:41.267445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:41.267578 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:41.268055 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:41.268059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:41.268061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:41.268467 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:41.269679 (+ 1212us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:41.269934 (+ 255us) server_negotiation.cc:299] Negotiation successful
0809 06:36:41.270108 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 06:36:41.273998 30598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6335e652170048edb35baeb28ddef9de. Latest consensus state: current_term: 1 leader_uuid: "6335e652170048edb35baeb28ddef9de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6335e652170048edb35baeb28ddef9de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43211 } } }
I20260809 06:36:41.274865 30598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:41.275954 30607 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:41.280514 30607 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:41.289111 30607 catalog_manager.cc:1347] Generated new cluster ID: 6a2928e62cd946bcba66d7e8d1acf1da
I20260809 06:36:41.289197 30607 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:41.310495 30607 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:41.311645 30607 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:41.325583 30607 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6335e652170048edb35baeb28ddef9de: Generated new TSK 0
I20260809 06:36:41.326555 30607 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:41.341315 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 30480
I20260809 06:36:41.342864 30573 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:41.432958 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 30480
W20260809 06:36:41.453325 30453 connection.cc:535] client connection to 127.0.0.1:43211 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43211): Connection reset by peer (error 104)
2026-08-09T06:36:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2118 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:41 dist-test-slave-cvwc krb5kdc[30629](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:41 dist-test-slave-cvwc krb5kdc[30629](info): set up 2 sockets
Aug 09 06:36:41 dist-test-slave-cvwc krb5kdc[30629](info): commencing operation
krb5kdc: starting...
W20260809 06:36:42.636628 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.165s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:42 dist-test-slave-cvwc krb5kdc[30629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:42.900593 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38785
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38785
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:43.225396 30651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:43.225683 30651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:43.225845 30651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:43.232844 30651 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:43.232976 30651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:43.233055 30651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:43.233146 30651 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:43.233206 30651 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:43.242914 30651 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38785
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:43.244201 30651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:43.245533 30651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:43.256901 30662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:43.256942 30666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:43.256958 30661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:43.258073 30651 server_base.cc:1034] running on GCE node
I20260809 06:36:43.258867 30651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:43.260226 30651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:43.261421 30651 hybrid_clock.cc:648] HybridClock initialized: now 1786257403261384 us; error 29 us; skew 500 ppm
I20260809 06:36:43.261811 30651 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:43 dist-test-slave-cvwc krb5kdc[30629](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257403, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:43.264904 30651 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:43.266412 30651 webserver.cc:460] Webserver started at http://127.0.0.1:35381/ using document root <none> and password file <none>
I20260809 06:36:43.267055 30651 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:43.267172 30651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:43.267457 30651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:43.270416 30651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "2911b8e3fa034090a86cca61b3960a26"
format_stamp: "Formatted at 2026-08-09 06:36:43 on dist-test-slave-cvwc"
server_key: "5894d862ef6c7d21dafb1720e129009c"
server_key_iv: "ae183383224fd87d84bce0ce810f62c0"
server_key_version: "encryptionkey@0"
I20260809 06:36:43.271149 30651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "2911b8e3fa034090a86cca61b3960a26"
format_stamp: "Formatted at 2026-08-09 06:36:43 on dist-test-slave-cvwc"
server_key: "5894d862ef6c7d21dafb1720e129009c"
server_key_iv: "ae183383224fd87d84bce0ce810f62c0"
server_key_version: "encryptionkey@0"
I20260809 06:36:43.276034 30651 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260809 06:36:43.279395 30675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:43.280620 30651 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:36:43.280771 30651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "2911b8e3fa034090a86cca61b3960a26"
format_stamp: "Formatted at 2026-08-09 06:36:43 on dist-test-slave-cvwc"
server_key: "5894d862ef6c7d21dafb1720e129009c"
server_key_iv: "ae183383224fd87d84bce0ce810f62c0"
server_key_version: "encryptionkey@0"
I20260809 06:36:43.280951 30651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:43.293141 30651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:43.297032 30651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:43.297276 30651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:43.313923 30651 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38785
I20260809 06:36:43.313946 30755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38785 every 8 connection(s)
I20260809 06:36:43.315167 30651 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:43.318598 30757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:43.323683 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 30651
I20260809 06:36:43.323853 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:43.324357 31033 external_mini_cluster.cc:1428] Setting key 72bef248c546570bf0d13d0acb032ab6
I20260809 06:36:43.329166 30757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26: Bootstrap starting.
I20260809 06:36:43.332556 30757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:43.333642 30757 log.cc:824] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:43.336423 30757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26: No bootstrap required, opened a new log
I20260809 06:36:43.337006 30760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:43.326063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56047 (local address 127.0.0.1:38785)
0809 06:36:43.326821 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:43.326836 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:43.326879 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:36:43.328523 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:43.328545 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:43.328901 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:43.329195 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:43.329789 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:43.331071 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:43.332828 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:43.333471 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:43.333589 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:43.334905 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:43.334914 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:43.334927 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:43.335403 (+ 476us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:43.335472 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:43.335496 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:43.335610 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:43.335876 (+ 266us) server_negotiation.cc:299] Negotiation successful
0809 06:36:43.336034 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":352,"threads_started":1}
I20260809 06:36:43.340461 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:43.343887 30757 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911b8e3fa034090a86cca61b3960a26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } }
I20260809 06:36:43.344220 30757 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:43.344322 30757 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2911b8e3fa034090a86cca61b3960a26, State: Initialized, Role: FOLLOWER
I20260809 06:36:43.344946 30757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911b8e3fa034090a86cca61b3960a26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } }
I20260809 06:36:43.345238 30757 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:43.345397 30757 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:43.345588 30757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:43.348397 30757 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911b8e3fa034090a86cca61b3960a26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } }
I20260809 06:36:43.348892 30757 leader_election.cc:302] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2911b8e3fa034090a86cca61b3960a26; no voters:
I20260809 06:36:43.349474 30757 leader_election.cc:288] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:43.349570 30773 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:43.351202 30760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:43.344385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37417 (local address 127.0.0.1:38785)
0809 06:36:43.344556 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:43.344562 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:43.345123 (+ 561us) server_negotiation.cc:407] Connection header received
0809 06:36:43.345285 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:43.345288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:43.345348 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:43.345430 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:43.346063 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:43.346823 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:43.348551 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:43.349031 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:43.349140 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:43.350319 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:43.350326 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:43.350331 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:43.350352 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:43.350437 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:43.350458 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:43.350558 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:43.350835 (+ 277us) server_negotiation.cc:299] Negotiation successful
0809 06:36:43.350898 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260809 06:36:43.351675 30757 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:43.356405 30773 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [term 1 LEADER]: Becoming Leader. State: Replica: 2911b8e3fa034090a86cca61b3960a26, State: Running, Role: LEADER
I20260809 06:36:43.356833 30773 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911b8e3fa034090a86cca61b3960a26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } }
I20260809 06:36:43.361903 30776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2911b8e3fa034090a86cca61b3960a26. Latest consensus state: current_term: 1 leader_uuid: "2911b8e3fa034090a86cca61b3960a26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911b8e3fa034090a86cca61b3960a26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } } }
I20260809 06:36:43.361855 30774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2911b8e3fa034090a86cca61b3960a26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911b8e3fa034090a86cca61b3960a26" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38785 } } }
I20260809 06:36:43.362222 30776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:43.362231 30774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26 [sys.catalog]: This master's current role is: LEADER
W20260809 06:36:43.365473 30791 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:36:43.365577 30791 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:36:43.365738 30792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:43.367364 30792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:43.375074 30792 catalog_manager.cc:1347] Generated new cluster ID: 57679cfea22c4c89bfd8a83e83784bc9
I20260809 06:36:43.375229 30792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:43.395803 30792 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:43.397018 30792 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:43.406605 30792 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2911b8e3fa034090a86cca61b3960a26: Generated new TSK 0
I20260809 06:36:43.407354 30792 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:43.418969 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 30651
W20260809 06:36:43.420429 30750 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56047
W20260809 06:36:43.421113 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 30651: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:36:43.421268 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 30651
W20260809 06:36:43.440764 30627 connection.cc:535] client connection to 127.0.0.1:38785 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38785): Connection reset by peer (error 104)
2026-08-09T06:36:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1987 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:43 dist-test-slave-cvwc krb5kdc[30800](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:43 dist-test-slave-cvwc krb5kdc[30800](info): set up 2 sockets
Aug 09 06:36:43 dist-test-slave-cvwc krb5kdc[30800](info): commencing operation
krb5kdc: starting...
W20260809 06:36:44.621795 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.163s user 0.009s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:44 dist-test-slave-cvwc krb5kdc[30800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:44.876796 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34813
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34813
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:45.199712 30820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:45.199976 30820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:45.200112 30820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:45.207108 30820 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:45.207213 30820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:45.207289 30820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:45.207370 30820 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:45.207432 30820 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:45.216877 30820 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34813
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34813
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:45.218149 30820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:45.219425 30820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:45.230562 30834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:45.230623 30828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:45.230623 30830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:45.231403 30820 server_base.cc:1034] running on GCE node
I20260809 06:36:45.232098 30820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:45.233382 30820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:45.234578 30820 hybrid_clock.cc:648] HybridClock initialized: now 1786257405234535 us; error 37 us; skew 500 ppm
I20260809 06:36:45.234894 30820 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:45 dist-test-slave-cvwc krb5kdc[30800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257405, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:45.241590 30820 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:45.242965 30820 webserver.cc:460] Webserver started at http://127.0.0.1:39101/ using document root <none> and password file <none>
I20260809 06:36:45.243598 30820 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:45.243716 30820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:45.244002 30820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:45.246891 30820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "e522516d920c4c6ca3e22ef78cedf269"
format_stamp: "Formatted at 2026-08-09 06:36:45 on dist-test-slave-cvwc"
server_key: "c34c02c048e62ea63203b34a68c25082"
server_key_iv: "1c467190228f40be4ec7cc9d01c0f83f"
server_key_version: "encryptionkey@0"
I20260809 06:36:45.247644 30820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "e522516d920c4c6ca3e22ef78cedf269"
format_stamp: "Formatted at 2026-08-09 06:36:45 on dist-test-slave-cvwc"
server_key: "c34c02c048e62ea63203b34a68c25082"
server_key_iv: "1c467190228f40be4ec7cc9d01c0f83f"
server_key_version: "encryptionkey@0"
I20260809 06:36:45.252431 30820 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:36:45.255730 30847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:45.256922 30820 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260809 06:36:45.257074 30820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "e522516d920c4c6ca3e22ef78cedf269"
format_stamp: "Formatted at 2026-08-09 06:36:45 on dist-test-slave-cvwc"
server_key: "c34c02c048e62ea63203b34a68c25082"
server_key_iv: "1c467190228f40be4ec7cc9d01c0f83f"
server_key_version: "encryptionkey@0"
I20260809 06:36:45.257248 30820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:45.262733 30820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:45.266361 30820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:45.266625 30820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:45.283303 30820 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34813
I20260809 06:36:45.283334 30920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34813 every 8 connection(s)
I20260809 06:36:45.284602 30820 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:45.288092 30923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:45.289844 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 30820
I20260809 06:36:45.290005 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:45.290426 31033 external_mini_cluster.cc:1428] Setting key e96628ea62cc048c1829996042e87aa8
I20260809 06:36:45.298261 30927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:45.292138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54075 (local address 127.0.0.1:34813)
0809 06:36:45.292960 (+ 822us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:45.292976 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:45.293032 (+ 56us) server_negotiation.cc:407] Connection header received
0809 06:36:45.294652 (+ 1620us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:45.294679 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:45.295109 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:45.295530 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:45.296400 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:45.296407 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:45.296423 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:45.296439 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:45.296507 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:45.296536 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:45.296737 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:45.296873 (+ 136us) server_negotiation.cc:299] Negotiation successful
0809 06:36:45.297067 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":347,"threads_started":1}
I20260809 06:36:45.301445 30923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269: Bootstrap starting.
I20260809 06:36:45.301589 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:45.305047 30923 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:45.306305 30923 log.cc:824] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:45.308950 30927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:45.306576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38839 (local address 127.0.0.1:34813)
0809 06:36:45.306742 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:45.306749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:45.307314 (+ 565us) server_negotiation.cc:407] Connection header received
0809 06:36:45.307423 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:45.307428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:45.307480 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:45.307565 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:45.308408 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:45.308412 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:45.308415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:45.308428 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:45.308462 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:45.308475 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:45.308554 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:45.308673 (+ 119us) server_negotiation.cc:299] Negotiation successful
0809 06:36:45.308710 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 06:36:45.309417 30923 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269: No bootstrap required, opened a new log
I20260809 06:36:45.316567 30923 raft_consensus.cc:348] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e522516d920c4c6ca3e22ef78cedf269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34813 } }
I20260809 06:36:45.316883 30923 raft_consensus.cc:374] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:45.316954 30923 raft_consensus.cc:729] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e522516d920c4c6ca3e22ef78cedf269, State: Initialized, Role: FOLLOWER
I20260809 06:36:45.317408 30923 consensus_queue.cc:260] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e522516d920c4c6ca3e22ef78cedf269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34813 } }
I20260809 06:36:45.317601 30923 raft_consensus.cc:388] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:45.317695 30923 raft_consensus.cc:482] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:45.317870 30923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:45.319845 30923 raft_consensus.cc:504] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e522516d920c4c6ca3e22ef78cedf269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34813 } }
I20260809 06:36:45.320331 30923 leader_election.cc:302] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e522516d920c4c6ca3e22ef78cedf269; no voters:
I20260809 06:36:45.320811 30923 leader_election.cc:288] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:45.320941 30938 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:45.321522 30938 raft_consensus.cc:686] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [term 1 LEADER]: Becoming Leader. State: Replica: e522516d920c4c6ca3e22ef78cedf269, State: Running, Role: LEADER
I20260809 06:36:45.322059 30938 consensus_queue.cc:237] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e522516d920c4c6ca3e22ef78cedf269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34813 } }
I20260809 06:36:45.322604 30923 sys_catalog.cc:564] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:45.324755 30942 sys_catalog.cc:455] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e522516d920c4c6ca3e22ef78cedf269. Latest consensus state: current_term: 1 leader_uuid: "e522516d920c4c6ca3e22ef78cedf269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e522516d920c4c6ca3e22ef78cedf269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34813 } } }
I20260809 06:36:45.324831 30940 sys_catalog.cc:455] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e522516d920c4c6ca3e22ef78cedf269" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e522516d920c4c6ca3e22ef78cedf269" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34813 } } }
I20260809 06:36:45.325249 30942 sys_catalog.cc:458] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:45.325273 30940 sys_catalog.cc:458] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:45.333180 30947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:45.338290 30947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:45.346695 30947 catalog_manager.cc:1347] Generated new cluster ID: a9bd25e9bde24f2eb247bb9fa1741e59
I20260809 06:36:45.346791 30947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:45.356352 30947 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:45.356782 30947 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:45.369470 30947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e522516d920c4c6ca3e22ef78cedf269: Generated new TSK 0
I20260809 06:36:45.370231 30947 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:45.382138 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 30820
W20260809 06:36:45.383175 30916 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54075
W20260809 06:36:45.383811 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 30820: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:36:45.383968 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 30820
2026-08-09T06:36:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1970 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:45 dist-test-slave-cvwc krb5kdc[30969](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:45 dist-test-slave-cvwc krb5kdc[30969](info): set up 2 sockets
Aug 09 06:36:45 dist-test-slave-cvwc krb5kdc[30969](info): commencing operation
krb5kdc: starting...
W20260809 06:36:46.590653 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:46 dist-test-slave-cvwc krb5kdc[30969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:46.840644 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34939
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34939
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:47.159008 30990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:47.159262 30990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:47.159358 30990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:47.166319 30990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:47.166414 30990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:47.166465 30990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:47.166523 30990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:47.166564 30990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:47.175820 30990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:47.176932 30990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:47.178146 30990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:47.189046 31001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:47.189152 31003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:47.189123 31008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:47.189600 30990 server_base.cc:1034] running on GCE node
I20260809 06:36:47.190420 30990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:47.191602 30990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:47.192785 30990 hybrid_clock.cc:648] HybridClock initialized: now 1786257407192740 us; error 37 us; skew 500 ppm
I20260809 06:36:47.193096 30990 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:47 dist-test-slave-cvwc krb5kdc[30969](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257407, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:47.196050 30990 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:47.197340 30990 webserver.cc:460] Webserver started at http://127.0.0.1:45211/ using document root <none> and password file <none>
I20260809 06:36:47.198004 30990 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:47.198120 30990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:47.198396 30990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:47.201153 30990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "d44fa68f31724046a42db3ce3013a621"
format_stamp: "Formatted at 2026-08-09 06:36:47 on dist-test-slave-cvwc"
server_key: "9313b4ae7b643bad2e632a35796db53d"
server_key_iv: "bdb6eb25c64c6deeb6a84a47f5f83a09"
server_key_version: "encryptionkey@0"
I20260809 06:36:47.201917 30990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "d44fa68f31724046a42db3ce3013a621"
format_stamp: "Formatted at 2026-08-09 06:36:47 on dist-test-slave-cvwc"
server_key: "9313b4ae7b643bad2e632a35796db53d"
server_key_iv: "bdb6eb25c64c6deeb6a84a47f5f83a09"
server_key_version: "encryptionkey@0"
I20260809 06:36:47.206564 30990 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:36:47.209632 31016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:47.210837 30990 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:36:47.210987 30990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "d44fa68f31724046a42db3ce3013a621"
format_stamp: "Formatted at 2026-08-09 06:36:47 on dist-test-slave-cvwc"
server_key: "9313b4ae7b643bad2e632a35796db53d"
server_key_iv: "bdb6eb25c64c6deeb6a84a47f5f83a09"
server_key_version: "encryptionkey@0"
I20260809 06:36:47.211148 30990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:47.233747 30990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:47.237808 30990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:47.238071 30990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:47.254820 30990 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34939
I20260809 06:36:47.254859 31101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34939 every 8 connection(s)
I20260809 06:36:47.256111 30990 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:47.259680 31103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:47.263927 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 30990
I20260809 06:36:47.264106 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:47.264667 31033 external_mini_cluster.cc:1428] Setting key b9399e84514e11870449001f53479f17
I20260809 06:36:47.270960 31103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621: Bootstrap starting.
I20260809 06:36:47.274434 31103 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:47.275624 31103 log.cc:824] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:47.278811 31103 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621: No bootstrap required, opened a new log
Aug 09 06:36:47 dist-test-slave-cvwc krb5kdc[30969](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 06:36:47.287895 31107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:47.266483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36753 (local address 127.0.0.1:34939)
0809 06:36:47.267206 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:47.267217 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:47.267258 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:36:47.269433 (+ 2175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:47.269457 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:47.269860 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:47.270176 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:47.271995 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:47.273311 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:47.275063 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:47.275801 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:47.275927 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:47.280711 (+ 4784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:47.280721 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:47.280738 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:47.280773 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:47.283925 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:47.284772 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:47.284779 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:47.284787 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:47.284951 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:47.285328 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:47.285331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:47.285333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:47.285902 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:47.286133 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:47.286551 (+ 418us) server_negotiation.cc:299] Negotiation successful
0809 06:36:47.286910 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":325,"threads_started":1}
I20260809 06:36:47.287720 31103 raft_consensus.cc:348] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44fa68f31724046a42db3ce3013a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34939 } }
I20260809 06:36:47.288065 31103 raft_consensus.cc:374] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:47.288168 31103 raft_consensus.cc:729] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fa68f31724046a42db3ce3013a621, State: Initialized, Role: FOLLOWER
I20260809 06:36:47.288705 31103 consensus_queue.cc:260] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44fa68f31724046a42db3ce3013a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34939 } }
I20260809 06:36:47.288925 31103 raft_consensus.cc:388] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:47.289070 31103 raft_consensus.cc:482] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:47.289264 31103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:47.291687 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:47.292199 31103 raft_consensus.cc:504] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44fa68f31724046a42db3ce3013a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34939 } }
I20260809 06:36:47.292737 31103 leader_election.cc:302] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d44fa68f31724046a42db3ce3013a621; no voters:
I20260809 06:36:47.293314 31103 leader_election.cc:288] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:47.293414 31109 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:47.295415 31103 sys_catalog.cc:564] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:47.300061 31109 raft_consensus.cc:686] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [term 1 LEADER]: Becoming Leader. State: Replica: d44fa68f31724046a42db3ce3013a621, State: Running, Role: LEADER
I20260809 06:36:47.300721 31109 consensus_queue.cc:237] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44fa68f31724046a42db3ce3013a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34939 } }
I20260809 06:36:47.303939 31113 sys_catalog.cc:455] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d44fa68f31724046a42db3ce3013a621. Latest consensus state: current_term: 1 leader_uuid: "d44fa68f31724046a42db3ce3013a621" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44fa68f31724046a42db3ce3013a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34939 } } }
I20260809 06:36:47.303911 31112 sys_catalog.cc:455] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d44fa68f31724046a42db3ce3013a621" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d44fa68f31724046a42db3ce3013a621" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34939 } } }
I20260809 06:36:47.304387 31113 sys_catalog.cc:458] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:47.304407 31112 sys_catalog.cc:458] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:47.317608 31128 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:47.319949 31107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:47.299826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40757 (local address 127.0.0.1:34939)
0809 06:36:47.300010 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:47.300015 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:47.305005 (+ 4990us) server_negotiation.cc:407] Connection header received
0809 06:36:47.305177 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:47.305181 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:47.305241 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:47.305322 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:47.306751 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:47.307450 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:47.308783 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:47.309256 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:47.309390 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:47.312652 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:47.312660 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:47.312666 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:47.312708 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:47.316626 (+ 3918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:47.317464 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:47.317468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:47.317470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:47.317579 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:47.318036 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:47.318042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:47.318045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:47.318586 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:47.318885 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:47.319369 (+ 484us) server_negotiation.cc:299] Negotiation successful
0809 06:36:47.319590 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:36:47.322636 31128 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:47.331259 31128 catalog_manager.cc:1347] Generated new cluster ID: 950428b5f40a471ebb7ec8c167a99b8e
I20260809 06:36:47.331354 31128 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:47.346848 31128 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:47.348212 31128 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:47.356870 31128 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d44fa68f31724046a42db3ce3013a621: Generated new TSK 0
I20260809 06:36:47.357583 31128 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:47.369220 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 30990
I20260809 06:36:47.370429 31097 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:47.458624 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 30990
2026-08-09T06:36:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2069 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:47 dist-test-slave-cvwc krb5kdc[31146](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:47 dist-test-slave-cvwc krb5kdc[31146](info): set up 2 sockets
Aug 09 06:36:47 dist-test-slave-cvwc krb5kdc[31146](info): commencing operation
krb5kdc: starting...
W20260809 06:36:48.671631 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:48 dist-test-slave-cvwc krb5kdc[31146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:48.928082 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39145
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:49.250255 31166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:49.250519 31166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:49.250646 31166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:49.257819 31166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:49.257926 31166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:49.258001 31166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:49.258088 31166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:49.258158 31166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:49.267567 31166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:49.268803 31166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:49.270072 31166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:49.280959 31176 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:49.280928 31173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:49.281147 31172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:49.281601 31166 server_base.cc:1034] running on GCE node
I20260809 06:36:49.282384 31166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:49.283665 31166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:49.284860 31166 hybrid_clock.cc:648] HybridClock initialized: now 1786257409284817 us; error 32 us; skew 500 ppm
I20260809 06:36:49.285163 31166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:49 dist-test-slave-cvwc krb5kdc[31146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257409, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:49.288093 31166 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:49.289397 31166 webserver.cc:460] Webserver started at http://127.0.0.1:38219/ using document root <none> and password file <none>
I20260809 06:36:49.290038 31166 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:49.290156 31166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:49.290437 31166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:49.293246 31166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "7e092f38fde04339b24c100bc4a03f4d"
format_stamp: "Formatted at 2026-08-09 06:36:49 on dist-test-slave-cvwc"
server_key: "89774109a9fd3532c04f86fcbc341c50"
server_key_iv: "b42c3421c392a6643c2675d16b286ad8"
server_key_version: "encryptionkey@0"
I20260809 06:36:49.294013 31166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "7e092f38fde04339b24c100bc4a03f4d"
format_stamp: "Formatted at 2026-08-09 06:36:49 on dist-test-slave-cvwc"
server_key: "89774109a9fd3532c04f86fcbc341c50"
server_key_iv: "b42c3421c392a6643c2675d16b286ad8"
server_key_version: "encryptionkey@0"
I20260809 06:36:49.298734 31166 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:36:49.301858 31186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:49.303004 31166 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260809 06:36:49.303157 31166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "7e092f38fde04339b24c100bc4a03f4d"
format_stamp: "Formatted at 2026-08-09 06:36:49 on dist-test-slave-cvwc"
server_key: "89774109a9fd3532c04f86fcbc341c50"
server_key_iv: "b42c3421c392a6643c2675d16b286ad8"
server_key_version: "encryptionkey@0"
I20260809 06:36:49.303328 31166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:49.326123 31166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:49.329772 31166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:49.330021 31166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:49.346354 31166 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39145
I20260809 06:36:49.346395 31266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39145 every 8 connection(s)
I20260809 06:36:49.347580 31166 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:49.351104 31267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:49.351138 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31166
I20260809 06:36:49.351287 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:49.351825 31033 external_mini_cluster.cc:1428] Setting key a35d6b2383d71f18ea65acd6961e367a
I20260809 06:36:49.364194 31267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d: Bootstrap starting.
I20260809 06:36:49.364305 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:49.353474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59315 (local address 127.0.0.1:39145)
0809 06:36:49.354274 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:49.354285 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:49.354328 (+ 43us) server_negotiation.cc:407] Connection header received
0809 06:36:49.356057 (+ 1729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:49.356078 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:49.356431 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:49.356739 (+ 308us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:49.357302 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:49.358618 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:49.360364 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:49.361000 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:49.361127 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:49.362286 (+ 1159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:49.362294 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:49.362306 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:49.362795 (+ 489us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:49.362864 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:49.362897 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:49.362979 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:49.363184 (+ 205us) server_negotiation.cc:299] Negotiation successful
0809 06:36:49.363393 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":382,"threads_started":1}
I20260809 06:36:49.367583 31267 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:49.367964 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:49.368799 31267 log.cc:824] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:49.371910 31267 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d: No bootstrap required, opened a new log
I20260809 06:36:49.378940 31270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:49.372761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53999 (local address 127.0.0.1:39145)
0809 06:36:49.372941 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:49.372946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:49.373278 (+ 332us) server_negotiation.cc:407] Connection header received
0809 06:36:49.373449 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:49.373453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:49.373506 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:49.373587 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:49.374159 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:49.374895 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:49.376649 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:49.377130 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:49.377220 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:49.378286 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:49.378290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:49.378293 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:49.378308 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:49.378346 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:49.378360 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:49.378438 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:49.378563 (+ 125us) server_negotiation.cc:299] Negotiation successful
0809 06:36:49.378628 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260809 06:36:49.381219 31267 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e092f38fde04339b24c100bc4a03f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } }
I20260809 06:36:49.381577 31267 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:49.381669 31267 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e092f38fde04339b24c100bc4a03f4d, State: Initialized, Role: FOLLOWER
I20260809 06:36:49.382206 31267 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e092f38fde04339b24c100bc4a03f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } }
I20260809 06:36:49.382436 31267 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:49.382556 31267 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:49.382709 31267 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:49.384872 31267 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e092f38fde04339b24c100bc4a03f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } }
I20260809 06:36:49.385319 31267 leader_election.cc:302] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7e092f38fde04339b24c100bc4a03f4d; no voters:
I20260809 06:36:49.385923 31267 leader_election.cc:288] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:49.386029 31282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:49.387817 31267 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:49.389537 31282 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [term 1 LEADER]: Becoming Leader. State: Replica: 7e092f38fde04339b24c100bc4a03f4d, State: Running, Role: LEADER
I20260809 06:36:49.390133 31282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e092f38fde04339b24c100bc4a03f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } }
I20260809 06:36:49.392777 31284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7e092f38fde04339b24c100bc4a03f4d. Latest consensus state: current_term: 1 leader_uuid: "7e092f38fde04339b24c100bc4a03f4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e092f38fde04339b24c100bc4a03f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } } }
I20260809 06:36:49.392851 31283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7e092f38fde04339b24c100bc4a03f4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7e092f38fde04339b24c100bc4a03f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39145 } } }
I20260809 06:36:49.393186 31284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:49.393187 31283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:49.398325 31299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:49.402133 31299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:49.410537 31299 catalog_manager.cc:1347] Generated new cluster ID: b87801f912af4986b2049cea727c8d84
I20260809 06:36:49.410694 31299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:49.420938 31299 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:49.422117 31299 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:49.431627 31299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7e092f38fde04339b24c100bc4a03f4d: Generated new TSK 0
I20260809 06:36:49.432271 31299 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:49.443337 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31166
W20260809 06:36:49.444254 31261 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:59315
W20260809 06:36:49.444890 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31166: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:36:49.445041 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31166
2026-08-09T06:36:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1986 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:49 dist-test-slave-cvwc krb5kdc[31313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:49 dist-test-slave-cvwc krb5kdc[31313](info): set up 2 sockets
Aug 09 06:36:49 dist-test-slave-cvwc krb5kdc[31313](info): commencing operation
krb5kdc: starting...
W20260809 06:36:50.662036 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:50 dist-test-slave-cvwc krb5kdc[31313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:50.930696 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39221
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:51.249585 31329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:51.249866 31329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:51.249997 31329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:51.256963 31329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:51.257069 31329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:51.257148 31329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:51.257226 31329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:51.257282 31329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:51.266878 31329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:51.268087 31329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:51.269343 31329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:51.280391 31336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:51.280455 31335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:51.280369 31339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:51.281457 31329 server_base.cc:1034] running on GCE node
I20260809 06:36:51.282224 31329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:51.283566 31329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:51.284803 31329 hybrid_clock.cc:648] HybridClock initialized: now 1786257411284750 us; error 43 us; skew 500 ppm
I20260809 06:36:51.285144 31329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:51 dist-test-slave-cvwc krb5kdc[31313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257411, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:51.288172 31329 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:51.289609 31329 webserver.cc:460] Webserver started at http://127.0.0.1:36047/ using document root <none> and password file <none>
I20260809 06:36:51.290269 31329 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:51.290390 31329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:51.290678 31329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:51.293581 31329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "6ae17333fc744a879385ff0aedd57344"
format_stamp: "Formatted at 2026-08-09 06:36:51 on dist-test-slave-cvwc"
server_key: "b29b0fbd7cd74691fae1bc161375bbba"
server_key_iv: "29883be465970ea44555fd28754a2411"
server_key_version: "encryptionkey@0"
I20260809 06:36:51.294356 31329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "6ae17333fc744a879385ff0aedd57344"
format_stamp: "Formatted at 2026-08-09 06:36:51 on dist-test-slave-cvwc"
server_key: "b29b0fbd7cd74691fae1bc161375bbba"
server_key_iv: "29883be465970ea44555fd28754a2411"
server_key_version: "encryptionkey@0"
I20260809 06:36:51.300055 31329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:36:51.303506 31348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:51.304774 31329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:36:51.304920 31329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "6ae17333fc744a879385ff0aedd57344"
format_stamp: "Formatted at 2026-08-09 06:36:51 on dist-test-slave-cvwc"
server_key: "b29b0fbd7cd74691fae1bc161375bbba"
server_key_iv: "29883be465970ea44555fd28754a2411"
server_key_version: "encryptionkey@0"
I20260809 06:36:51.305086 31329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:51.310536 31329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:51.314051 31329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:51.314320 31329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:51.330971 31329 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39221
I20260809 06:36:51.331017 31423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39221 every 8 connection(s)
I20260809 06:36:51.332216 31329 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:51.335624 31425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:51.342092 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31329
I20260809 06:36:51.342279 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:51.342808 31033 external_mini_cluster.cc:1428] Setting key 98b1259756fd6cbbd0cb963c395f9190
I20260809 06:36:51.346062 31425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344: Bootstrap starting.
I20260809 06:36:51.349294 31425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:51.350119 31429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:51.344473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54199 (local address 127.0.0.1:39221)
0809 06:36:51.345220 (+ 747us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:51.345231 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:51.345278 (+ 47us) server_negotiation.cc:407] Connection header received
0809 06:36:51.346946 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:51.346967 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:51.347279 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:51.347592 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:51.348606 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:51.348613 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:51.348626 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:51.348640 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:51.348698 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:51.348719 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:51.348856 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:51.349009 (+ 153us) server_negotiation.cc:299] Negotiation successful
0809 06:36:51.349169 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":338,"threads_started":1}
I20260809 06:36:51.350407 31425 log.cc:824] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:51.353391 31425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344: No bootstrap required, opened a new log
I20260809 06:36:51.353876 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:51.362069 31425 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae17333fc744a879385ff0aedd57344" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39221 } }
I20260809 06:36:51.362462 31425 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:51.362581 31425 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ae17333fc744a879385ff0aedd57344, State: Initialized, Role: FOLLOWER
I20260809 06:36:51.363091 31425 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae17333fc744a879385ff0aedd57344" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39221 } }
I20260809 06:36:51.363334 31425 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:51.363482 31425 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:51.363664 31425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:51.363950 31429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:51.358883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52731 (local address 127.0.0.1:39221)
0809 06:36:51.359059 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:51.359064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:51.362193 (+ 3129us) server_negotiation.cc:407] Connection header received
0809 06:36:51.362306 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:51.362312 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:51.362381 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:51.362493 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:51.363309 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:51.363314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:51.363318 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:51.363340 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:51.363393 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:51.363415 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:51.363549 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:51.363641 (+ 92us) server_negotiation.cc:299] Negotiation successful
0809 06:36:51.363701 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:36:51.366379 31425 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae17333fc744a879385ff0aedd57344" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39221 } }
I20260809 06:36:51.366786 31425 leader_election.cc:302] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ae17333fc744a879385ff0aedd57344; no voters:
I20260809 06:36:51.367303 31425 leader_election.cc:288] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:51.367471 31442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:51.368165 31442 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [term 1 LEADER]: Becoming Leader. State: Replica: 6ae17333fc744a879385ff0aedd57344, State: Running, Role: LEADER
I20260809 06:36:51.368748 31442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae17333fc744a879385ff0aedd57344" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39221 } }
I20260809 06:36:51.369535 31425 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:51.371591 31448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ae17333fc744a879385ff0aedd57344. Latest consensus state: current_term: 1 leader_uuid: "6ae17333fc744a879385ff0aedd57344" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae17333fc744a879385ff0aedd57344" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39221 } } }
I20260809 06:36:51.371603 31447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ae17333fc744a879385ff0aedd57344" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ae17333fc744a879385ff0aedd57344" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39221 } } }
I20260809 06:36:51.372160 31447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:51.372136 31448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344 [sys.catalog]: This master's current role is: LEADER
W20260809 06:36:51.381438 31467 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:36:51.381541 31467 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:36:51.381671 31455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:51.384027 31455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:51.392174 31455 catalog_manager.cc:1347] Generated new cluster ID: 1f220d83bbb8486a8152d82dcb565c74
I20260809 06:36:51.392273 31455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:51.434406 31455 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:51.434788 31455 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:51.441768 31455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ae17333fc744a879385ff0aedd57344: Generated new TSK 0
I20260809 06:36:51.442456 31455 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:51.453438 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31329
W20260809 06:36:51.454550 31416 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54199
W20260809 06:36:51.455251 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31329: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:36:51.455380 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31329
2026-08-09T06:36:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2011 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:51 dist-test-slave-cvwc krb5kdc[31476](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:51 dist-test-slave-cvwc krb5kdc[31476](info): set up 2 sockets
Aug 09 06:36:51 dist-test-slave-cvwc krb5kdc[31476](info): commencing operation
krb5kdc: starting...
W20260809 06:36:52.667191 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.006s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:52 dist-test-slave-cvwc krb5kdc[31476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:52.938999 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40215
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40215
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:53.259112 31493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:53.259414 31493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:53.259567 31493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:53.266571 31493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:53.266688 31493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:53.266767 31493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:53.266849 31493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:53.266916 31493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:53.276656 31493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:53.277968 31493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:53.279247 31493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:53.290282 31498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:53.290256 31501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:53.290243 31499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:53.291075 31493 server_base.cc:1034] running on GCE node
I20260809 06:36:53.291776 31493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:53.293092 31493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:53.294310 31493 hybrid_clock.cc:648] HybridClock initialized: now 1786257413294259 us; error 33 us; skew 500 ppm
I20260809 06:36:53.294612 31493 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:53 dist-test-slave-cvwc krb5kdc[31476](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257413, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:53.297508 31493 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:53.298923 31493 webserver.cc:460] Webserver started at http://127.0.0.1:38763/ using document root <none> and password file <none>
I20260809 06:36:53.299561 31493 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:53.299674 31493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:53.299964 31493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:53.302827 31493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "a9af82a210bb4bc98062fa06a07d8483"
format_stamp: "Formatted at 2026-08-09 06:36:53 on dist-test-slave-cvwc"
server_key: "525651d74e9858ba6d2df44ef0ddd159"
server_key_iv: "9d1efa530a2997bc71446218a0f011df"
server_key_version: "encryptionkey@0"
I20260809 06:36:53.303567 31493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "a9af82a210bb4bc98062fa06a07d8483"
format_stamp: "Formatted at 2026-08-09 06:36:53 on dist-test-slave-cvwc"
server_key: "525651d74e9858ba6d2df44ef0ddd159"
server_key_iv: "9d1efa530a2997bc71446218a0f011df"
server_key_version: "encryptionkey@0"
I20260809 06:36:53.308296 31493 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:36:53.311456 31509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:53.312631 31493 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:36:53.312785 31493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "a9af82a210bb4bc98062fa06a07d8483"
format_stamp: "Formatted at 2026-08-09 06:36:53 on dist-test-slave-cvwc"
server_key: "525651d74e9858ba6d2df44ef0ddd159"
server_key_iv: "9d1efa530a2997bc71446218a0f011df"
server_key_version: "encryptionkey@0"
I20260809 06:36:53.312979 31493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:53.332724 31493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:53.336313 31493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:53.336556 31493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:53.352512 31493 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40215
I20260809 06:36:53.352550 31583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40215 every 8 connection(s)
I20260809 06:36:53.353750 31493 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:53.357129 31584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:53.360584 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31493
I20260809 06:36:53.360759 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:53.361308 31033 external_mini_cluster.cc:1428] Setting key 787c7bfd64b272904707de64daf7fb73
I20260809 06:36:53.369171 31584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483: Bootstrap starting.
I20260809 06:36:53.372731 31584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:53.374050 31584 log.cc:824] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:36:53 dist-test-slave-cvwc krb5kdc[31476](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 06:36:53.377043 31584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483: No bootstrap required, opened a new log
I20260809 06:36:53.383627 31587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:53.362970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:35497 (local address 127.0.0.1:40215)
0809 06:36:53.363643 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:53.363654 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:53.363693 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:36:53.365386 (+ 1693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:53.365413 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:53.365843 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:53.366152 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:53.367875 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:53.369105 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:53.370860 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:53.371511 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:53.371634 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:53.376552 (+ 4918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:53.376560 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:53.376573 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:53.376611 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:53.379627 (+ 3016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:53.380526 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:53.380532 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:53.380539 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:53.380692 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:53.381118 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:53.381121 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:53.381123 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:53.381638 (+ 515us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:53.381914 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:53.382315 (+ 401us) server_negotiation.cc:299] Negotiation successful
0809 06:36:53.382611 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":296,"threads_started":1}
I20260809 06:36:53.385696 31584 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af82a210bb4bc98062fa06a07d8483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } }
I20260809 06:36:53.386171 31584 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:53.386274 31584 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9af82a210bb4bc98062fa06a07d8483, State: Initialized, Role: FOLLOWER
I20260809 06:36:53.386839 31584 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af82a210bb4bc98062fa06a07d8483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } }
I20260809 06:36:53.387065 31584 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:53.387199 31584 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:53.387354 31584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:53.387365 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:53.389374 31584 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af82a210bb4bc98062fa06a07d8483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } }
I20260809 06:36:53.389883 31584 leader_election.cc:302] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9af82a210bb4bc98062fa06a07d8483; no voters:
I20260809 06:36:53.390502 31584 leader_election.cc:288] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:53.390594 31593 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:53.392729 31593 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [term 1 LEADER]: Becoming Leader. State: Replica: a9af82a210bb4bc98062fa06a07d8483, State: Running, Role: LEADER
I20260809 06:36:53.392855 31584 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:53.393335 31593 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af82a210bb4bc98062fa06a07d8483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } }
I20260809 06:36:53.396148 31595 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9af82a210bb4bc98062fa06a07d8483" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af82a210bb4bc98062fa06a07d8483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } } }
I20260809 06:36:53.396543 31595 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:53.397033 31597 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9af82a210bb4bc98062fa06a07d8483. Latest consensus state: current_term: 1 leader_uuid: "a9af82a210bb4bc98062fa06a07d8483" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9af82a210bb4bc98062fa06a07d8483" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40215 } } }
I20260809 06:36:53.397284 31597 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:53.408216 31587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:53.391909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:35567 (local address 127.0.0.1:40215)
0809 06:36:53.392081 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:53.392087 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:53.392703 (+ 616us) server_negotiation.cc:407] Connection header received
0809 06:36:53.392960 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:53.392965 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:53.393040 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:53.393096 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:53.394816 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:53.395976 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:53.397826 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:53.398583 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:53.398708 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:53.402117 (+ 3409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:53.402124 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:53.402130 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:53.402161 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:53.405461 (+ 3300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:53.406293 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:53.406297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:53.406299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:53.406407 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:53.406858 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:53.406861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:53.406863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:53.407168 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:53.407392 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:53.407787 (+ 395us) server_negotiation.cc:299] Negotiation successful
0809 06:36:53.407958 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:36:53.410557 31605 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:53.415566 31605 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:53.424065 31605 catalog_manager.cc:1347] Generated new cluster ID: f39c79b379064196bfe723c50e7cded9
I20260809 06:36:53.424152 31605 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:53.453066 31605 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:53.454335 31605 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:53.467546 31605 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9af82a210bb4bc98062fa06a07d8483: Generated new TSK 0
I20260809 06:36:53.468317 31605 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:53.473585 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31493
I20260809 06:36:53.474674 31576 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:53.564693 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31493
W20260809 06:36:53.585937 31473 connection.cc:535] client connection to 127.0.0.1:40215 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40215): Connection reset by peer (error 104)
2026-08-09T06:36:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2106 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:53 dist-test-slave-cvwc krb5kdc[31637](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:53 dist-test-slave-cvwc krb5kdc[31637](info): set up 2 sockets
Aug 09 06:36:53 dist-test-slave-cvwc krb5kdc[31637](info): commencing operation
krb5kdc: starting...
W20260809 06:36:54.772935 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:54 dist-test-slave-cvwc krb5kdc[31637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257414, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:55.036906 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34513
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34513
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:55.358119 31653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:55.358392 31653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:55.358551 31653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:55.365554 31653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:55.365657 31653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:55.365763 31653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:55.365842 31653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:55.365903 31653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:55.375655 31653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34513
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:55.376910 31653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:55.378213 31653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:55.389153 31659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:55.389132 31663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:55.389358 31658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:55.389987 31653 server_base.cc:1034] running on GCE node
I20260809 06:36:55.390739 31653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:55.392020 31653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:55.393224 31653 hybrid_clock.cc:648] HybridClock initialized: now 1786257415393184 us; error 32 us; skew 500 ppm
I20260809 06:36:55.393543 31653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:55 dist-test-slave-cvwc krb5kdc[31637](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257415, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:55.396504 31653 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:55.397986 31653 webserver.cc:460] Webserver started at http://127.0.0.1:45659/ using document root <none> and password file <none>
I20260809 06:36:55.398648 31653 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:55.398765 31653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:55.399047 31653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:55.402179 31653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "2de194714e794d1f92bcdc2d22061c1c"
format_stamp: "Formatted at 2026-08-09 06:36:55 on dist-test-slave-cvwc"
server_key: "e1925185cb5934343be1740796bd85be"
server_key_iv: "05f160c4574e2fd09c37acc765f49306"
server_key_version: "encryptionkey@0"
I20260809 06:36:55.402932 31653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "2de194714e794d1f92bcdc2d22061c1c"
format_stamp: "Formatted at 2026-08-09 06:36:55 on dist-test-slave-cvwc"
server_key: "e1925185cb5934343be1740796bd85be"
server_key_iv: "05f160c4574e2fd09c37acc765f49306"
server_key_version: "encryptionkey@0"
I20260809 06:36:55.407759 31653 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:36:55.411057 31672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:55.412278 31653 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:36:55.412431 31653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "2de194714e794d1f92bcdc2d22061c1c"
format_stamp: "Formatted at 2026-08-09 06:36:55 on dist-test-slave-cvwc"
server_key: "e1925185cb5934343be1740796bd85be"
server_key_iv: "05f160c4574e2fd09c37acc765f49306"
server_key_version: "encryptionkey@0"
I20260809 06:36:55.412595 31653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:55.445057 31653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:55.448683 31653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:55.448971 31653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:55.465663 31653 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34513
I20260809 06:36:55.465698 31744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34513 every 8 connection(s)
I20260809 06:36:55.467012 31653 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:55.469441 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31653
I20260809 06:36:55.469596 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:55.470080 31033 external_mini_cluster.cc:1428] Setting key cbb87bafe1731e1e11cb5e2dbc97af94
I20260809 06:36:55.470679 31747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:55.482995 31751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:55.471746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:51575 (local address 127.0.0.1:34513)
0809 06:36:55.472475 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:55.472490 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:55.472531 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:36:55.474088 (+ 1557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:55.474109 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:55.474501 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:55.474836 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:55.475450 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:55.476770 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:55.478675 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:55.479343 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:55.479474 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:55.480752 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:55.480760 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:55.480781 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:55.481319 (+ 538us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:55.481394 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:55.481424 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:55.481542 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:55.481885 (+ 343us) server_negotiation.cc:299] Negotiation successful
0809 06:36:55.482076 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":327,"threads_started":1}
I20260809 06:36:55.483898 31747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c: Bootstrap starting.
I20260809 06:36:55.486698 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:55.487493 31747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:55.488660 31747 log.cc:824] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:55.491537 31747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c: No bootstrap required, opened a new log
I20260809 06:36:55.497946 31751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:55.491629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:42187 (local address 127.0.0.1:34513)
0809 06:36:55.491786 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:55.491791 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:55.492118 (+ 327us) server_negotiation.cc:407] Connection header received
0809 06:36:55.492254 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:55.492259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:55.492348 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:55.492450 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:55.492863 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:55.494029 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:55.495284 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:55.495933 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:55.496073 (+ 140us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:55.497070 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:55.497077 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:55.497085 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:55.497153 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:55.497245 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:55.497268 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:55.497401 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:55.497564 (+ 163us) server_negotiation.cc:299] Negotiation successful
0809 06:36:55.497617 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:36:55.500521 31747 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2de194714e794d1f92bcdc2d22061c1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34513 } }
I20260809 06:36:55.500839 31747 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:55.500917 31747 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2de194714e794d1f92bcdc2d22061c1c, State: Initialized, Role: FOLLOWER
I20260809 06:36:55.501405 31747 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2de194714e794d1f92bcdc2d22061c1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34513 } }
I20260809 06:36:55.501603 31747 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:55.501698 31747 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:55.501885 31747 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:55.503937 31747 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2de194714e794d1f92bcdc2d22061c1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34513 } }
I20260809 06:36:55.504361 31747 leader_election.cc:302] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2de194714e794d1f92bcdc2d22061c1c; no voters:
I20260809 06:36:55.504936 31747 leader_election.cc:288] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:55.505066 31760 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:55.505890 31760 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [term 1 LEADER]: Becoming Leader. State: Replica: 2de194714e794d1f92bcdc2d22061c1c, State: Running, Role: LEADER
I20260809 06:36:55.506381 31760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2de194714e794d1f92bcdc2d22061c1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34513 } }
I20260809 06:36:55.506902 31747 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:55.508950 31762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2de194714e794d1f92bcdc2d22061c1c. Latest consensus state: current_term: 1 leader_uuid: "2de194714e794d1f92bcdc2d22061c1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2de194714e794d1f92bcdc2d22061c1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34513 } } }
I20260809 06:36:55.509322 31762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:55.514559 31761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2de194714e794d1f92bcdc2d22061c1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2de194714e794d1f92bcdc2d22061c1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34513 } } }
I20260809 06:36:55.515148 31761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:55.516516 31766 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:55.521842 31766 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:55.529987 31766 catalog_manager.cc:1347] Generated new cluster ID: d1326f3e0d6b42f085f721cf968d3410
I20260809 06:36:55.530079 31766 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:55.551554 31766 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:55.552775 31766 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:55.565863 31766 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2de194714e794d1f92bcdc2d22061c1c: Generated new TSK 0
I20260809 06:36:55.566642 31766 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:55.576508 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31653
W20260809 06:36:55.577615 31737 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.198:51575
W20260809 06:36:55.578325 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31653: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:36:55.578467 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31653
W20260809 06:36:55.602054 31633 connection.cc:535] client connection to 127.0.0.1:34513 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34513): Connection reset by peer (error 104)
2026-08-09T06:36:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2016 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:55 dist-test-slave-cvwc krb5kdc[31795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:55 dist-test-slave-cvwc krb5kdc[31795](info): set up 2 sockets
Aug 09 06:36:55 dist-test-slave-cvwc krb5kdc[31795](info): commencing operation
krb5kdc: starting...
W20260809 06:36:56.797142 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:56 dist-test-slave-cvwc krb5kdc[31795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:57.050789 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44057
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44057
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:57.372154 31815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:57.372423 31815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:57.372555 31815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:57.379566 31815 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:57.379671 31815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:57.379747 31815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:57.379830 31815 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:57.379889 31815 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:57.389158 31815 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44057
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:57.390290 31815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:57.391502 31815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:57.402434 31820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:57.402479 31823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:57.402503 31821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:57.403199 31815 server_base.cc:1034] running on GCE node
I20260809 06:36:57.403887 31815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:57.405097 31815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:57.406284 31815 hybrid_clock.cc:648] HybridClock initialized: now 1786257417406239 us; error 37 us; skew 500 ppm
I20260809 06:36:57.406597 31815 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:57 dist-test-slave-cvwc krb5kdc[31795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257417, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:57.409446 31815 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:57.410822 31815 webserver.cc:460] Webserver started at http://127.0.0.1:46195/ using document root <none> and password file <none>
I20260809 06:36:57.411419 31815 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:57.411533 31815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:57.411803 31815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:57.414798 31815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "bce1a32b7aca4bec812df393f5293c72"
format_stamp: "Formatted at 2026-08-09 06:36:57 on dist-test-slave-cvwc"
server_key: "91f1706dc045ee5eb7101040a7cf32e1"
server_key_iv: "0584d56b9f992ef68211e7f32f42a45f"
server_key_version: "encryptionkey@0"
I20260809 06:36:57.415534 31815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "bce1a32b7aca4bec812df393f5293c72"
format_stamp: "Formatted at 2026-08-09 06:36:57 on dist-test-slave-cvwc"
server_key: "91f1706dc045ee5eb7101040a7cf32e1"
server_key_iv: "0584d56b9f992ef68211e7f32f42a45f"
server_key_version: "encryptionkey@0"
I20260809 06:36:57.420217 31815 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:36:57.423386 31834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:57.424551 31815 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:36:57.424703 31815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "bce1a32b7aca4bec812df393f5293c72"
format_stamp: "Formatted at 2026-08-09 06:36:57 on dist-test-slave-cvwc"
server_key: "91f1706dc045ee5eb7101040a7cf32e1"
server_key_iv: "0584d56b9f992ef68211e7f32f42a45f"
server_key_version: "encryptionkey@0"
I20260809 06:36:57.424867 31815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:57.430145 31815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:57.433530 31815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:57.433811 31815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:57.450160 31815 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44057
I20260809 06:36:57.450217 31906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44057 every 8 connection(s)
I20260809 06:36:57.451372 31815 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:57.451648 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31815
I20260809 06:36:57.451797 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:57.452208 31033 external_mini_cluster.cc:1428] Setting key bbdb5a47ea6fc4749d3a3a6a8de518cb
I20260809 06:36:57.455420 31908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:57.459412 31914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:57.453957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:59155 (local address 127.0.0.1:44057)
0809 06:36:57.454666 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:57.454676 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:57.454715 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:36:57.456320 (+ 1605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:57.456341 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:57.456641 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:57.456981 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:57.457949 (+ 968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:57.457955 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:57.457967 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:57.457993 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:57.458066 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:57.458087 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:57.458299 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:57.458426 (+ 127us) server_negotiation.cc:299] Negotiation successful
0809 06:36:57.458608 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":311,"threads_started":1}
I20260809 06:36:57.462821 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:57.466351 31908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72: Bootstrap starting.
I20260809 06:36:57.469235 31914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:57.467021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:58891 (local address 127.0.0.1:44057)
0809 06:36:57.467170 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:57.467176 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:57.467520 (+ 344us) server_negotiation.cc:407] Connection header received
0809 06:36:57.467676 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:57.467679 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:57.467725 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:57.467811 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:57.468643 (+ 832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:57.468649 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:57.468654 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:36:57.468671 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:57.468705 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:36:57.468719 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:57.468816 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:57.468926 (+ 110us) server_negotiation.cc:299] Negotiation successful
0809 06:36:57.468983 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260809 06:36:57.469688 31908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:57.470816 31908 log.cc:824] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72: Log is configured to *not* fsync() on all Append() calls
I20260809 06:36:57.473336 31908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72: No bootstrap required, opened a new log
I20260809 06:36:57.480674 31908 raft_consensus.cc:348] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bce1a32b7aca4bec812df393f5293c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44057 } }
I20260809 06:36:57.481021 31908 raft_consensus.cc:374] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:57.481112 31908 raft_consensus.cc:729] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bce1a32b7aca4bec812df393f5293c72, State: Initialized, Role: FOLLOWER
I20260809 06:36:57.481642 31908 consensus_queue.cc:260] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bce1a32b7aca4bec812df393f5293c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44057 } }
I20260809 06:36:57.481942 31908 raft_consensus.cc:388] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:57.482074 31908 raft_consensus.cc:482] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:57.482234 31908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:57.484368 31908 raft_consensus.cc:504] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bce1a32b7aca4bec812df393f5293c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44057 } }
I20260809 06:36:57.484890 31908 leader_election.cc:302] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bce1a32b7aca4bec812df393f5293c72; no voters:
I20260809 06:36:57.485430 31908 leader_election.cc:288] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:57.485543 31928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:57.486730 31928 raft_consensus.cc:686] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [term 1 LEADER]: Becoming Leader. State: Replica: bce1a32b7aca4bec812df393f5293c72, State: Running, Role: LEADER
I20260809 06:36:57.487293 31928 consensus_queue.cc:237] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bce1a32b7aca4bec812df393f5293c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44057 } }
I20260809 06:36:57.487628 31908 sys_catalog.cc:564] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:57.489970 31930 sys_catalog.cc:455] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bce1a32b7aca4bec812df393f5293c72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bce1a32b7aca4bec812df393f5293c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44057 } } }
I20260809 06:36:57.490037 31931 sys_catalog.cc:455] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bce1a32b7aca4bec812df393f5293c72. Latest consensus state: current_term: 1 leader_uuid: "bce1a32b7aca4bec812df393f5293c72" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bce1a32b7aca4bec812df393f5293c72" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44057 } } }
I20260809 06:36:57.490433 31930 sys_catalog.cc:458] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:57.490445 31931 sys_catalog.cc:458] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72 [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:57.492976 31942 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:57.496915 31942 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:57.504441 31942 catalog_manager.cc:1347] Generated new cluster ID: 30ea9d3b891c4acbad5f4ae186d7d27f
I20260809 06:36:57.504544 31942 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:57.517033 31942 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:57.517385 31942 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:57.523344 31942 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bce1a32b7aca4bec812df393f5293c72: Generated new TSK 0
I20260809 06:36:57.523983 31942 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:57.531335 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31815
W20260809 06:36:57.532764 31898 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.198:59155
W20260809 06:36:57.533371 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31815: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:36:57.533550 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31815
2026-08-09T06:36:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1953 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:57 dist-test-slave-cvwc krb5kdc[31960](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:57 dist-test-slave-cvwc krb5kdc[31960](info): set up 2 sockets
Aug 09 06:36:57 dist-test-slave-cvwc krb5kdc[31960](info): commencing operation
krb5kdc: starting...
W20260809 06:36:58.732533 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.005s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:36:58 dist-test-slave-cvwc krb5kdc[31960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:36:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:36:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:36:58.992532 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36749
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37939
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:36:59.324780 31985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:36:59.325057 31985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:36:59.325201 31985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:36:59.332372 31985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:36:59.332490 31985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:36:59.332576 31985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:36:59.332671 31985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:36:59.332755 31985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:36:59.342397 31985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37939
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36749
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:36:59.343602 31985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:36:59.344936 31985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:36:59.356403 31996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:59.356860 31995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:36:59.356912 32000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:36:59.357241 31985 server_base.cc:1034] running on GCE node
I20260809 06:36:59.358047 31985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:36:59.359380 31985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:36:59.360571 31985 hybrid_clock.cc:648] HybridClock initialized: now 1786257419360529 us; error 41 us; skew 500 ppm
I20260809 06:36:59.360889 31985 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:36:59 dist-test-slave-cvwc krb5kdc[31960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257419, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:36:59.363797 31985 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:36:59.365123 31985 webserver.cc:460] Webserver started at http://127.0.0.1:43883/ using document root <none> and password file <none>
I20260809 06:36:59.365747 31985 fs_manager.cc:359] Metadata directory not provided
I20260809 06:36:59.365877 31985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:36:59.366154 31985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:36:59.369246 31985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "d855e7de5eaf4e86ba1c362e4b491b3f"
format_stamp: "Formatted at 2026-08-09 06:36:59 on dist-test-slave-cvwc"
server_key: "df63cb5edf8666a1d1eb629da509c670"
server_key_iv: "2a1ddbc7b444ca5bc48bc22cce1448bf"
server_key_version: "encryptionkey@0"
I20260809 06:36:59.370114 31985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "d855e7de5eaf4e86ba1c362e4b491b3f"
format_stamp: "Formatted at 2026-08-09 06:36:59 on dist-test-slave-cvwc"
server_key: "df63cb5edf8666a1d1eb629da509c670"
server_key_iv: "2a1ddbc7b444ca5bc48bc22cce1448bf"
server_key_version: "encryptionkey@0"
I20260809 06:36:59.375312 31985 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:36:59.378731 32015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:36:59.379981 31985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:36:59.380146 31985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "d855e7de5eaf4e86ba1c362e4b491b3f"
format_stamp: "Formatted at 2026-08-09 06:36:59 on dist-test-slave-cvwc"
server_key: "df63cb5edf8666a1d1eb629da509c670"
server_key_iv: "2a1ddbc7b444ca5bc48bc22cce1448bf"
server_key_version: "encryptionkey@0"
I20260809 06:36:59.380338 31985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:36:59.404757 31985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:36:59.408493 31985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:36:59.408769 31985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:36:59.426263 31985 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36749
I20260809 06:36:59.426293 32097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36749 every 8 connection(s)
I20260809 06:36:59.427567 31985 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:36:59.430996 32098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:36:59.434514 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 31985
I20260809 06:36:59.434691 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:36:59.435252 31033 external_mini_cluster.cc:1428] Setting key f549e174f5ac4c8bfbc148b78f23ec5a
I20260809 06:36:59.443055 32098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f: Bootstrap starting.
I20260809 06:36:59.446604 32098 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f: Neither blocks nor log segments found. Creating new log.
I20260809 06:36:59.447826 32098 log.cc:824] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:36:59 dist-test-slave-cvwc krb5kdc[31960](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257418, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260809 06:36:59.450440 32098 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f: No bootstrap required, opened a new log
I20260809 06:36:59.456883 32106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:59.436941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:60991 (local address 127.0.0.1:36749)
0809 06:36:59.437590 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:59.437601 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:59.437639 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:36:59.439268 (+ 1629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:59.439288 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:59.439655 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:59.439965 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:59.441624 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:59.442910 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:59.444667 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:59.445292 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:59.445411 (+ 119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:59.450012 (+ 4601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:59.450020 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:59.450032 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:59.450069 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:59.452967 (+ 2898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:59.453765 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:59.453774 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:59.453782 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:59.453949 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:59.454382 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:59.454386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:59.454388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:59.454886 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:59.455194 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:59.455673 (+ 479us) server_negotiation.cc:299] Negotiation successful
0809 06:36:59.455965 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":284,"threads_started":1}
I20260809 06:36:59.458138 32098 raft_consensus.cc:348] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d855e7de5eaf4e86ba1c362e4b491b3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36749 } }
I20260809 06:36:59.458474 32098 raft_consensus.cc:374] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:36:59.458568 32098 raft_consensus.cc:729] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d855e7de5eaf4e86ba1c362e4b491b3f, State: Initialized, Role: FOLLOWER
I20260809 06:36:59.459167 32098 consensus_queue.cc:260] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d855e7de5eaf4e86ba1c362e4b491b3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36749 } }
I20260809 06:36:59.459386 32098 raft_consensus.cc:388] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:36:59.459532 32098 raft_consensus.cc:482] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:36:59.459730 32098 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:36:59.460390 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:36:59.461913 32098 raft_consensus.cc:504] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d855e7de5eaf4e86ba1c362e4b491b3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36749 } }
I20260809 06:36:59.462357 32098 leader_election.cc:302] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d855e7de5eaf4e86ba1c362e4b491b3f; no voters:
I20260809 06:36:59.462926 32098 leader_election.cc:288] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:36:59.463011 32108 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:36:59.469653 32108 raft_consensus.cc:686] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [term 1 LEADER]: Becoming Leader. State: Replica: d855e7de5eaf4e86ba1c362e4b491b3f, State: Running, Role: LEADER
I20260809 06:36:59.470283 32108 consensus_queue.cc:237] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d855e7de5eaf4e86ba1c362e4b491b3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36749 } }
I20260809 06:36:59.471473 32098 sys_catalog.cc:564] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:36:59.473098 32113 sys_catalog.cc:455] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d855e7de5eaf4e86ba1c362e4b491b3f. Latest consensus state: current_term: 1 leader_uuid: "d855e7de5eaf4e86ba1c362e4b491b3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d855e7de5eaf4e86ba1c362e4b491b3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36749 } } }
I20260809 06:36:59.473620 32113 sys_catalog.cc:458] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:59.475867 32112 sys_catalog.cc:455] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d855e7de5eaf4e86ba1c362e4b491b3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d855e7de5eaf4e86ba1c362e4b491b3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36749 } } }
I20260809 06:36:59.476166 32112 sys_catalog.cc:458] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f [sys.catalog]: This master's current role is: LEADER
I20260809 06:36:59.478399 32121 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:36:59.483711 32121 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:36:59.487324 32106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:36:59.464754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:59821 (local address 127.0.0.1:36749)
0809 06:36:59.464924 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0809 06:36:59.464930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:36:59.470454 (+ 5524us) server_negotiation.cc:407] Connection header received
0809 06:36:59.470664 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:36:59.470670 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:36:59.470743 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:36:59.470827 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:36:59.472521 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:59.473646 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:59.474998 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:36:59.475651 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:36:59.475780 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:36:59.479178 (+ 3398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:36:59.479185 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:36:59.479190 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:36:59.479242 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:36:59.482963 (+ 3721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:59.483959 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:59.483964 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:59.483967 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:59.484105 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:36:59.484812 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:36:59.484817 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:36:59.484820 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:36:59.485239 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:36:59.485518 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0809 06:36:59.486770 (+ 1252us) server_negotiation.cc:299] Negotiation successful
0809 06:36:59.486962 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:36:59.493085 32121 catalog_manager.cc:1347] Generated new cluster ID: 632fd7ed36f44282a2939742334b36eb
I20260809 06:36:59.493191 32121 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:36:59.516999 32121 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:36:59.518289 32121 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:36:59.528946 32121 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d855e7de5eaf4e86ba1c362e4b491b3f: Generated new TSK 0
I20260809 06:36:59.529660 32121 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:36:59.536128 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 31985
I20260809 06:36:59.537309 32091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:36:59.627627 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 31985
W20260809 06:36:59.648397 31958 connection.cc:535] client connection to 127.0.0.1:36749 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36749): Connection reset by peer (error 104)
2026-08-09T06:36:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2092 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:36:59 dist-test-slave-cvwc krb5kdc[32162](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:36:59 dist-test-slave-cvwc krb5kdc[32162](info): set up 2 sockets
Aug 09 06:36:59 dist-test-slave-cvwc krb5kdc[32162](info): commencing operation
krb5kdc: starting...
W20260809 06:37:00.856375 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.189s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:01 dist-test-slave-cvwc krb5kdc[32162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257421, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:37:01.116708 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39981
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39981
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:01.434875 32175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:01.435145 32175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:01.435300 32175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:01.442171 32175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:01.442277 32175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:01.442355 32175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:01.442440 32175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:01.442502 32175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:01.451687 32175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39981
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:01.452838 32175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:01.454113 32175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:01.464926 32183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:01.465103 32184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:01.465108 32187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:01.465992 32175 server_base.cc:1034] running on GCE node
I20260809 06:37:01.466704 32175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:01.468004 32175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:01.469198 32175 hybrid_clock.cc:648] HybridClock initialized: now 1786257421469152 us; error 34 us; skew 500 ppm
I20260809 06:37:01.469512 32175 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:01 dist-test-slave-cvwc krb5kdc[32162](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257421, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:01.472431 32175 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:37:01.473812 32175 webserver.cc:460] Webserver started at http://127.0.0.1:46873/ using document root <none> and password file <none>
I20260809 06:37:01.474452 32175 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:01.474568 32175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:01.474849 32175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:01.477751 32175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "c43b687aa007454484de66222ec42192"
format_stamp: "Formatted at 2026-08-09 06:37:01 on dist-test-slave-cvwc"
server_key: "418673bf965cdb30883b5f13ca4df23b"
server_key_iv: "8d96f10f2656baaf26c4ef672fe2b60f"
server_key_version: "encryptionkey@0"
I20260809 06:37:01.478516 32175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "c43b687aa007454484de66222ec42192"
format_stamp: "Formatted at 2026-08-09 06:37:01 on dist-test-slave-cvwc"
server_key: "418673bf965cdb30883b5f13ca4df23b"
server_key_iv: "8d96f10f2656baaf26c4ef672fe2b60f"
server_key_version: "encryptionkey@0"
I20260809 06:37:01.483393 32175 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260809 06:37:01.486637 32196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:01.487959 32175 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260809 06:37:01.488104 32175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "c43b687aa007454484de66222ec42192"
format_stamp: "Formatted at 2026-08-09 06:37:01 on dist-test-slave-cvwc"
server_key: "418673bf965cdb30883b5f13ca4df23b"
server_key_iv: "8d96f10f2656baaf26c4ef672fe2b60f"
server_key_version: "encryptionkey@0"
I20260809 06:37:01.488276 32175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:01.507462 32175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:01.511031 32175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:01.511268 32175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:01.527817 32175 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39981
I20260809 06:37:01.527833 32279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39981 every 8 connection(s)
I20260809 06:37:01.529085 32175 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:01.532492 32280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:01.538220 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 32175
I20260809 06:37:01.538369 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:01.538811 31033 external_mini_cluster.cc:1428] Setting key 6bac5995bc76f11aa2117539e067d811
I20260809 06:37:01.542475 32280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192: Bootstrap starting.
I20260809 06:37:01.545617 32280 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:01.546553 32280 log.cc:824] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:01.549131 32280 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192: No bootstrap required, opened a new log
I20260809 06:37:01.551054 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:01.540500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:58153 (local address 127.0.0.1:39981)
0809 06:37:01.541227 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:01.541238 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:01.541276 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:37:01.543046 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:01.543069 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:01.543451 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:01.543814 (+ 363us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:01.544354 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:01.545596 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:01.546896 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:01.547570 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:01.547741 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:01.548903 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:01.548911 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:01.548924 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:01.549437 (+ 513us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:01.549519 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:01.549546 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:01.549673 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:01.550010 (+ 337us) server_negotiation.cc:299] Negotiation successful
0809 06:37:01.550148 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":323,"threads_started":1}
I20260809 06:37:01.554481 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:01.556475 32280 raft_consensus.cc:348] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c43b687aa007454484de66222ec42192" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } }
I20260809 06:37:01.556843 32280 raft_consensus.cc:374] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:37:01.556959 32280 raft_consensus.cc:729] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c43b687aa007454484de66222ec42192, State: Initialized, Role: FOLLOWER
I20260809 06:37:01.557533 32280 consensus_queue.cc:260] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c43b687aa007454484de66222ec42192" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } }
I20260809 06:37:01.557765 32280 raft_consensus.cc:388] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:37:01.557895 32280 raft_consensus.cc:482] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:37:01.558043 32280 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:01.560933 32280 raft_consensus.cc:504] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c43b687aa007454484de66222ec42192" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } }
I20260809 06:37:01.561424 32280 leader_election.cc:302] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c43b687aa007454484de66222ec42192; no voters:
I20260809 06:37:01.562070 32280 leader_election.cc:288] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:37:01.562160 32298 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:01.563308 32298 raft_consensus.cc:686] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [term 1 LEADER]: Becoming Leader. State: Replica: c43b687aa007454484de66222ec42192, State: Running, Role: LEADER
I20260809 06:37:01.563926 32298 consensus_queue.cc:237] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c43b687aa007454484de66222ec42192" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } }
I20260809 06:37:01.564287 32280 sys_catalog.cc:564] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:01.565150 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:01.558623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:52677 (local address 127.0.0.1:39981)
0809 06:37:01.558806 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:01.558814 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:01.559096 (+ 282us) server_negotiation.cc:407] Connection header received
0809 06:37:01.559220 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:01.559224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:01.559294 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:01.559415 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:01.559851 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:01.560898 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:01.562289 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:01.562999 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:01.563112 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:01.564366 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:01.564372 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:01.564387 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:01.564407 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:01.564473 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:01.564489 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:01.564577 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:01.564786 (+ 209us) server_negotiation.cc:299] Negotiation successful
0809 06:37:01.564837 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:37:01.572890 32301 sys_catalog.cc:455] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c43b687aa007454484de66222ec42192. Latest consensus state: current_term: 1 leader_uuid: "c43b687aa007454484de66222ec42192" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c43b687aa007454484de66222ec42192" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } } }
I20260809 06:37:01.572858 32300 sys_catalog.cc:455] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c43b687aa007454484de66222ec42192" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c43b687aa007454484de66222ec42192" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39981 } } }
I20260809 06:37:01.573290 32301 sys_catalog.cc:458] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:01.573346 32300 sys_catalog.cc:458] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:01.574368 32321 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:01.579118 32321 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:01.587790 32321 catalog_manager.cc:1347] Generated new cluster ID: de4850b6c5bf4f2f8d0a6a74d29b3bb9
I20260809 06:37:01.587903 32321 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:01.596776 32321 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:01.597975 32321 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:01.608762 32321 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c43b687aa007454484de66222ec42192: Generated new TSK 0
I20260809 06:37:01.609660 32321 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:37:01.619676 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32175
W20260809 06:37:01.620730 32272 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.198:58153
W20260809 06:37:01.621369 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32175: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:37:01.621523 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 32175
W20260809 06:37:01.646718 32158 connection.cc:535] client connection to 127.0.0.1:39981 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39981): Connection reset by peer (error 104)
2026-08-09T06:37:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1998 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:37:01 dist-test-slave-cvwc krb5kdc[32330](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:37:01 dist-test-slave-cvwc krb5kdc[32330](info): set up 2 sockets
Aug 09 06:37:01 dist-test-slave-cvwc krb5kdc[32330](info): commencing operation
krb5kdc: starting...
W20260809 06:37:02.833870 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.169s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:03 dist-test-slave-cvwc krb5kdc[32330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260809 06:37:03.099238 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35253
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35253
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:03.419589 32351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:03.419844 32351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:03.419981 32351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:03.426883 32351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:03.426980 32351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:03.427049 32351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:03.427126 32351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:03.427182 32351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:03.436363 32351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35253
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:03.437474 32351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:03.438705 32351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:03.449313 32357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:03.449388 32359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:03.449358 32361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:03.450340 32351 server_base.cc:1034] running on GCE node
I20260809 06:37:03.451045 32351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:03.452286 32351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:03.453480 32351 hybrid_clock.cc:648] HybridClock initialized: now 1786257423453444 us; error 27 us; skew 500 ppm
I20260809 06:37:03.453820 32351 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:03 dist-test-slave-cvwc krb5kdc[32330](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257423, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:03.456805 32351 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260809 06:37:03.458132 32351 webserver.cc:460] Webserver started at http://127.0.0.1:42307/ using document root <none> and password file <none>
I20260809 06:37:03.458736 32351 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:03.458834 32351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:03.459065 32351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:03.461809 32351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "faa1075bb34a49d8a8b93021bb579f5a"
format_stamp: "Formatted at 2026-08-09 06:37:03 on dist-test-slave-cvwc"
server_key: "e9b5601cd1837a96890345977e294dad"
server_key_iv: "729971197b635d52afc33fb1f73209b1"
server_key_version: "encryptionkey@0"
I20260809 06:37:03.462504 32351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "faa1075bb34a49d8a8b93021bb579f5a"
format_stamp: "Formatted at 2026-08-09 06:37:03 on dist-test-slave-cvwc"
server_key: "e9b5601cd1837a96890345977e294dad"
server_key_iv: "729971197b635d52afc33fb1f73209b1"
server_key_version: "encryptionkey@0"
I20260809 06:37:03.467129 32351 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:37:03.470353 32373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:03.471562 32351 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260809 06:37:03.471691 32351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "faa1075bb34a49d8a8b93021bb579f5a"
format_stamp: "Formatted at 2026-08-09 06:37:03 on dist-test-slave-cvwc"
server_key: "e9b5601cd1837a96890345977e294dad"
server_key_iv: "729971197b635d52afc33fb1f73209b1"
server_key_version: "encryptionkey@0"
I20260809 06:37:03.471846 32351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:03.477566 32351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:03.481403 32351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:03.481645 32351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:03.498217 32351 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35253
I20260809 06:37:03.498277 32451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35253 every 8 connection(s)
I20260809 06:37:03.499552 32351 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:03.503041 32452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:03.503283 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 32351
I20260809 06:37:03.503466 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:03.504002 31033 external_mini_cluster.cc:1428] Setting key c39f4a36fba950bca3296fbd54036787
I20260809 06:37:03.511291 32460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:03.505773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:42565 (local address 127.0.0.1:35253)
0809 06:37:03.506574 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:03.506585 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:03.506625 (+ 40us) server_negotiation.cc:407] Connection header received
0809 06:37:03.508083 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:03.508104 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:03.508408 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:03.508754 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:03.509771 (+ 1017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:03.509779 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:03.509794 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:03.509808 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:03.509872 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:03.509904 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:03.510117 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:03.510243 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 06:37:03.510444 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":320,"threads_started":1}
I20260809 06:37:03.514740 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:03.515897 32452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a: Bootstrap starting.
I20260809 06:37:03.518800 32452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:03.520081 32452 log.cc:824] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:03.521018 32460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:03.518673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.198:40943 (local address 127.0.0.1:35253)
0809 06:37:03.518850 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:03.518857 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:03.519299 (+ 442us) server_negotiation.cc:407] Connection header received
0809 06:37:03.519458 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:03.519462 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:03.519502 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:03.519567 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:03.520439 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:03.520443 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:03.520445 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:03.520458 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:03.520492 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:03.520506 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:03.520610 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:03.520736 (+ 126us) server_negotiation.cc:299] Negotiation successful
0809 06:37:03.520792 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:37:03.523033 32452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a: No bootstrap required, opened a new log
I20260809 06:37:03.530112 32452 raft_consensus.cc:348] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa1075bb34a49d8a8b93021bb579f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35253 } }
I20260809 06:37:03.530437 32452 raft_consensus.cc:374] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:37:03.530524 32452 raft_consensus.cc:729] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faa1075bb34a49d8a8b93021bb579f5a, State: Initialized, Role: FOLLOWER
I20260809 06:37:03.531015 32452 consensus_queue.cc:260] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa1075bb34a49d8a8b93021bb579f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35253 } }
I20260809 06:37:03.531224 32452 raft_consensus.cc:388] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:37:03.531344 32452 raft_consensus.cc:482] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:37:03.531489 32452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:03.533573 32452 raft_consensus.cc:504] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa1075bb34a49d8a8b93021bb579f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35253 } }
I20260809 06:37:03.534029 32452 leader_election.cc:302] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: faa1075bb34a49d8a8b93021bb579f5a; no voters:
I20260809 06:37:03.534523 32452 leader_election.cc:288] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:37:03.534629 32472 raft_consensus.cc:2781] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:03.535209 32472 raft_consensus.cc:686] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [term 1 LEADER]: Becoming Leader. State: Replica: faa1075bb34a49d8a8b93021bb579f5a, State: Running, Role: LEADER
I20260809 06:37:03.535694 32472 consensus_queue.cc:237] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa1075bb34a49d8a8b93021bb579f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35253 } }
I20260809 06:37:03.536267 32452 sys_catalog.cc:564] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:03.539386 32473 sys_catalog.cc:455] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "faa1075bb34a49d8a8b93021bb579f5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa1075bb34a49d8a8b93021bb579f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35253 } } }
I20260809 06:37:03.539849 32473 sys_catalog.cc:458] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:03.539382 32475 sys_catalog.cc:455] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader faa1075bb34a49d8a8b93021bb579f5a. Latest consensus state: current_term: 1 leader_uuid: "faa1075bb34a49d8a8b93021bb579f5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "faa1075bb34a49d8a8b93021bb579f5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35253 } } }
I20260809 06:37:03.540083 32475 sys_catalog.cc:458] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:03.542558 32490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:03.547191 32490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:03.555210 32490 catalog_manager.cc:1347] Generated new cluster ID: b798a5457fbd40be83380a92fbc0a837
I20260809 06:37:03.555311 32490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:03.580857 32490 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:03.581336 32490 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:03.597159 32490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P faa1075bb34a49d8a8b93021bb579f5a: Generated new TSK 0
I20260809 06:37:03.598165 32490 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:37:03.607384 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32351
W20260809 06:37:03.608457 32444 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.198:42565
W20260809 06:37:03.609055 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32351: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:37:03.609179 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 32351
2026-08-09T06:37:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1987 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:37:03 dist-test-slave-cvwc krb5kdc[32504](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:37:03 dist-test-slave-cvwc krb5kdc[32504](info): set up 2 sockets
Aug 09 06:37:03 dist-test-slave-cvwc krb5kdc[32504](info): commencing operation
krb5kdc: starting...
W20260809 06:37:04.812252 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:04 dist-test-slave-cvwc krb5kdc[32504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:37:05.070745 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:34851
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:36757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:34851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:05.401676 32527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:05.402019 32527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:05.402174 32527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:05.409330 32527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:05.409453 32527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:05.409541 32527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:05.409634 32527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:05.409736 32527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:05.419381 32527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:36757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:34851
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:34851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:05.420558 32527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:05.421943 32527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:05.433322 32533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:05.433333 32541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:05.433398 32535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:05.434350 32527 server_base.cc:1034] running on GCE node
I20260809 06:37:05.435052 32527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:05.436224 32527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:05.437434 32527 hybrid_clock.cc:648] HybridClock initialized: now 1786257425437379 us; error 43 us; skew 500 ppm
I20260809 06:37:05.437796 32527 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:05 dist-test-slave-cvwc krb5kdc[32504](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257425, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:05.440655 32527 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:37:05.442044 32527 webserver.cc:460] Webserver started at http://127.30.78.126:44695/ using document root <none> and password file <none>
I20260809 06:37:05.442647 32527 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:05.442761 32527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:05.443032 32527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:05.445822 32527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "ddff705f0558472188c6bf7c84779697"
format_stamp: "Formatted at 2026-08-09 06:37:05 on dist-test-slave-cvwc"
server_key: "eab9f62a3d25d338a56547abcbeb2edd"
server_key_iv: "046718d35dc0e560ae5a2b8681aaac14"
server_key_version: "encryptionkey@0"
I20260809 06:37:05.446552 32527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "ddff705f0558472188c6bf7c84779697"
format_stamp: "Formatted at 2026-08-09 06:37:05 on dist-test-slave-cvwc"
server_key: "eab9f62a3d25d338a56547abcbeb2edd"
server_key_iv: "046718d35dc0e560ae5a2b8681aaac14"
server_key_version: "encryptionkey@0"
I20260809 06:37:05.451198 32527 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260809 06:37:05.454325 32550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:05.455453 32527 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:37:05.455605 32527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "ddff705f0558472188c6bf7c84779697"
format_stamp: "Formatted at 2026-08-09 06:37:05 on dist-test-slave-cvwc"
server_key: "eab9f62a3d25d338a56547abcbeb2edd"
server_key_iv: "046718d35dc0e560ae5a2b8681aaac14"
server_key_version: "encryptionkey@0"
I20260809 06:37:05.455772 32527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:05.466689 32527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:05.470095 32527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:05.470338 32527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:05.486897 32527 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:34851
I20260809 06:37:05.486927 32623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:34851 every 8 connection(s)
I20260809 06:37:05.488155 32527 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:05.491654 32624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:05.494782 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 32527
I20260809 06:37:05.494963 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:05.495488 31033 external_mini_cluster.cc:1428] Setting key c093dc00170ff9128f4f6d81e1c104f7
I20260809 06:37:05.503217 32624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697: Bootstrap starting.
I20260809 06:37:05.506760 32624 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:05.507985 32624 log.cc:824] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:37:05 dist-test-slave-cvwc krb5kdc[32504](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257424, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:37:05.510854 32624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697: No bootstrap required, opened a new log
I20260809 06:37:05.518318 32629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:05.497159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45781 (local address 127.30.78.126:34851)
0809 06:37:05.497854 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:05.497865 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:05.497904 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:37:05.499468 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:05.499488 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:05.499895 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:05.500199 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:05.501904 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:05.503161 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:05.504862 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:05.505498 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:05.505616 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:05.510201 (+ 4585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:05.510212 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:05.510230 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:05.510273 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:05.514058 (+ 3785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:05.514768 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:05.514780 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:05.514787 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:05.515007 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:05.515414 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:05.515419 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:05.515423 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:05.516049 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:05.516409 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:05.516696 (+ 287us) server_negotiation.cc:299] Negotiation successful
0809 06:37:05.517023 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":301,"threads_started":1}
I20260809 06:37:05.520877 32624 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddff705f0558472188c6bf7c84779697" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34851 } }
I20260809 06:37:05.521212 32624 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:37:05.521320 32624 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddff705f0558472188c6bf7c84779697, State: Initialized, Role: FOLLOWER
I20260809 06:37:05.521950 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:05.521919 32624 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddff705f0558472188c6bf7c84779697" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34851 } }
I20260809 06:37:05.522158 32624 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:37:05.522277 32624 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:37:05.522426 32624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:05.524422 32624 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddff705f0558472188c6bf7c84779697" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34851 } }
I20260809 06:37:05.524904 32624 leader_election.cc:302] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddff705f0558472188c6bf7c84779697; no voters:
I20260809 06:37:05.525426 32624 leader_election.cc:288] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:37:05.525599 32637 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:05.527110 32624 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:05.529999 32637 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [term 1 LEADER]: Becoming Leader. State: Replica: ddff705f0558472188c6bf7c84779697, State: Running, Role: LEADER
I20260809 06:37:05.530619 32637 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddff705f0558472188c6bf7c84779697" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34851 } }
I20260809 06:37:05.533298 32641 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddff705f0558472188c6bf7c84779697. Latest consensus state: current_term: 1 leader_uuid: "ddff705f0558472188c6bf7c84779697" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddff705f0558472188c6bf7c84779697" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34851 } } }
I20260809 06:37:05.533697 32641 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:05.534276 32638 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddff705f0558472188c6bf7c84779697" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddff705f0558472188c6bf7c84779697" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34851 } } }
I20260809 06:37:05.534544 32638 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:05.541879 32651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:05.547098 32651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:05.560031 32651 catalog_manager.cc:1347] Generated new cluster ID: 7158dc28198e42cc9560d649ebc57d44
I20260809 06:37:05.560527 32651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:05.568558 32629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:05.544088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54507 (local address 127.30.78.126:34851)
0809 06:37:05.544251 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:05.544257 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:05.552457 (+ 8200us) server_negotiation.cc:407] Connection header received
0809 06:37:05.552738 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:05.552744 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:05.552830 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:05.552911 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:05.554942 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:05.556104 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:05.557900 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:05.558616 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:05.558725 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:05.561912 (+ 3187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:05.561918 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:05.561923 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:05.561957 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:05.565348 (+ 3391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:05.566214 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:05.566219 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:05.566223 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:05.566395 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:05.566920 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:05.566925 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:05.566928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:05.567282 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:05.567538 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:05.568013 (+ 475us) server_negotiation.cc:299] Negotiation successful
0809 06:37:05.568181 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":51}
I20260809 06:37:05.570442 32651 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:05.571585 32651 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:05.579007 32651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddff705f0558472188c6bf7c84779697: Generated new TSK 0
I20260809 06:37:05.580003 32651 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:37:05.587003 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32527
I20260809 06:37:05.588156 32615 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:37:05.674273 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 32527
W20260809 06:37:05.696826 32501 connection.cc:535] client connection to 127.30.78.126:34851 recv error: Network error: failed to read from TLS socket (remote: 127.30.78.126:34851): Connection reset by peer (error 104)
2026-08-09T06:37:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2061 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:37:05 dist-test-slave-cvwc krb5kdc[32677](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:37:05 dist-test-slave-cvwc krb5kdc[32677](info): set up 2 sockets
Aug 09 06:37:05 dist-test-slave-cvwc krb5kdc[32677](info): commencing operation
krb5kdc: starting...
W20260809 06:37:06.899448 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.006s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:07 dist-test-slave-cvwc krb5kdc[32677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:37:07.154525 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:32781
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:44223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:32781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:07.473871 32693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:07.474148 32693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:07.474248 32693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:07.481305 32693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:07.481419 32693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:07.481478 32693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:07.481537 32693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:07.481580 32693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:07.491209 32693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:44223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:32781
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:32781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:07.492386 32693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:07.493643 32693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:07.504498 32701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:07.504583 32700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:07.504558 32703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:07.505570 32693 server_base.cc:1034] running on GCE node
I20260809 06:37:07.506309 32693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:07.507570 32693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:07.508749 32693 hybrid_clock.cc:648] HybridClock initialized: now 1786257427508703 us; error 41 us; skew 500 ppm
I20260809 06:37:07.509048 32693 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:07 dist-test-slave-cvwc krb5kdc[32677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257427, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:07.512001 32693 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:37:07.513387 32693 webserver.cc:460] Webserver started at http://127.30.78.126:33567/ using document root <none> and password file <none>
I20260809 06:37:07.514051 32693 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:07.514169 32693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:07.514458 32693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:07.517259 32693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "a6c535b770e947be8f446e2b7aa3894b"
format_stamp: "Formatted at 2026-08-09 06:37:07 on dist-test-slave-cvwc"
server_key: "acc940ee27dd7d379cefb0485a15ec56"
server_key_iv: "0995010e3c407fbf8523a1e1e9f476d1"
server_key_version: "encryptionkey@0"
I20260809 06:37:07.518066 32693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "a6c535b770e947be8f446e2b7aa3894b"
format_stamp: "Formatted at 2026-08-09 06:37:07 on dist-test-slave-cvwc"
server_key: "acc940ee27dd7d379cefb0485a15ec56"
server_key_iv: "0995010e3c407fbf8523a1e1e9f476d1"
server_key_version: "encryptionkey@0"
I20260809 06:37:07.522807 32693 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260809 06:37:07.525949 32713 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:07.527119 32693 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 06:37:07.527262 32693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "a6c535b770e947be8f446e2b7aa3894b"
format_stamp: "Formatted at 2026-08-09 06:37:07 on dist-test-slave-cvwc"
server_key: "acc940ee27dd7d379cefb0485a15ec56"
server_key_iv: "0995010e3c407fbf8523a1e1e9f476d1"
server_key_version: "encryptionkey@0"
I20260809 06:37:07.527447 32693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:07.542742 32693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:07.546176 32693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:07.546414 32693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:07.562830 32693 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:32781
I20260809 06:37:07.562863 315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:32781 every 8 connection(s)
I20260809 06:37:07.564023 32693 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:07.565163 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 32693
I20260809 06:37:07.565356 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:07.565937 31033 external_mini_cluster.cc:1428] Setting key 86e36ac40df7571db6c59a62703fc67c
I20260809 06:37:07.568261 316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:07.577915 322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:07.567613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33291 (local address 127.30.78.126:32781)
0809 06:37:07.568321 (+ 708us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:07.568336 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:07.568385 (+ 49us) server_negotiation.cc:407] Connection header received
0809 06:37:07.569984 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:07.570005 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:07.570353 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:07.570710 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:07.571224 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:07.572528 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:07.573803 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:07.574453 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:07.574620 (+ 167us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:07.575798 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:07.575805 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:07.575820 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:07.576350 (+ 530us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:07.576417 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:07.576447 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:07.576594 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:07.576861 (+ 267us) server_negotiation.cc:299] Negotiation successful
0809 06:37:07.577007 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":310,"threads_started":1}
I20260809 06:37:07.578694 316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b: Bootstrap starting.
I20260809 06:37:07.581542 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:07.581924 316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:07.582839 316 log.cc:824] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:07.585455 316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b: No bootstrap required, opened a new log
I20260809 06:37:07.592067 322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:07.585911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42451 (local address 127.30.78.126:32781)
0809 06:37:07.586077 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:07.586083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:07.586453 (+ 370us) server_negotiation.cc:407] Connection header received
0809 06:37:07.586588 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:07.586592 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:07.586659 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:07.586760 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:07.587221 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:07.588340 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:07.589563 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:07.590278 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:07.590422 (+ 144us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:07.591378 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:07.591384 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:07.591389 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:07.591409 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:07.591450 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:07.591469 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:07.591579 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:07.591691 (+ 112us) server_negotiation.cc:299] Negotiation successful
0809 06:37:07.591742 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 06:37:07.594144 316 raft_consensus.cc:348] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6c535b770e947be8f446e2b7aa3894b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32781 } }
I20260809 06:37:07.594462 316 raft_consensus.cc:374] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:37:07.594532 316 raft_consensus.cc:729] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6c535b770e947be8f446e2b7aa3894b, State: Initialized, Role: FOLLOWER
I20260809 06:37:07.595021 316 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6c535b770e947be8f446e2b7aa3894b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32781 } }
I20260809 06:37:07.595217 316 raft_consensus.cc:388] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:37:07.595336 316 raft_consensus.cc:482] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:37:07.595485 316 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:07.597685 316 raft_consensus.cc:504] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6c535b770e947be8f446e2b7aa3894b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32781 } }
I20260809 06:37:07.598197 316 leader_election.cc:302] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6c535b770e947be8f446e2b7aa3894b; no voters:
I20260809 06:37:07.598706 316 leader_election.cc:288] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:37:07.598814 331 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:07.599349 331 raft_consensus.cc:686] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [term 1 LEADER]: Becoming Leader. State: Replica: a6c535b770e947be8f446e2b7aa3894b, State: Running, Role: LEADER
I20260809 06:37:07.599886 331 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6c535b770e947be8f446e2b7aa3894b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32781 } }
I20260809 06:37:07.601406 331 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6c535b770e947be8f446e2b7aa3894b. Latest consensus state: current_term: 1 leader_uuid: "a6c535b770e947be8f446e2b7aa3894b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6c535b770e947be8f446e2b7aa3894b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32781 } } }
I20260809 06:37:07.602031 331 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:07.602682 333 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6c535b770e947be8f446e2b7aa3894b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6c535b770e947be8f446e2b7aa3894b" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 32781 } } }
I20260809 06:37:07.602981 333 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:07.603955 316 sys_catalog.cc:564] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:07.604166 337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:07.608520 337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:07.616461 337 catalog_manager.cc:1347] Generated new cluster ID: dd4227bcde9f4711beda63ddff41ff87
I20260809 06:37:07.616568 337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:07.632488 337 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:07.634142 337 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:07.649732 337 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a6c535b770e947be8f446e2b7aa3894b: Generated new TSK 0
I20260809 06:37:07.650429 337 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:37:07.658205 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32693
W20260809 06:37:07.659230 310 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:33291
W20260809 06:37:07.659916 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 32693: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:37:07.660075 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 32693
W20260809 06:37:07.686952 32674 connection.cc:535] client connection to 127.30.78.126:32781 recv error: Network error: failed to read from TLS socket (remote: 127.30.78.126:32781): Connection reset by peer (error 104)
2026-08-09T06:37:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1990 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:37:07 dist-test-slave-cvwc krb5kdc[359](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:37:07 dist-test-slave-cvwc krb5kdc[359](info): set up 2 sockets
Aug 09 06:37:07 dist-test-slave-cvwc krb5kdc[359](info): commencing operation
krb5kdc: starting...
W20260809 06:37:08.877981 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.004s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:09 dist-test-slave-cvwc krb5kdc[359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257429, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:37:09.134406 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:42213
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:42885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:42213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:09.451459 381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:09.451707 381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:09.451802 381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:09.458552 381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:09.458642 381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:09.458693 381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:09.458750 381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:09.458791 381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:09.467864 381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:42885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:42213
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:42213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:09.469000 381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:09.470204 381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:09.481105 388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:09.481139 394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:09.481058 390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:09.481977 381 server_base.cc:1034] running on GCE node
I20260809 06:37:09.482714 381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:09.484022 381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:09.485219 381 hybrid_clock.cc:648] HybridClock initialized: now 1786257429485178 us; error 36 us; skew 500 ppm
I20260809 06:37:09.485527 381 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:09 dist-test-slave-cvwc krb5kdc[359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257429, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:09.488421 381 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:37:09.489845 381 webserver.cc:460] Webserver started at http://127.30.78.126:45513/ using document root <none> and password file <none>
I20260809 06:37:09.490473 381 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:09.490586 381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:09.490861 381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:09.493682 381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "25481d447f0145738181c2f517e41310"
format_stamp: "Formatted at 2026-08-09 06:37:09 on dist-test-slave-cvwc"
server_key: "72d6dab2236e0401aa2ee2bcea892963"
server_key_iv: "5138a7fc243d7018de010d691d242072"
server_key_version: "encryptionkey@0"
I20260809 06:37:09.494449 381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "25481d447f0145738181c2f517e41310"
format_stamp: "Formatted at 2026-08-09 06:37:09 on dist-test-slave-cvwc"
server_key: "72d6dab2236e0401aa2ee2bcea892963"
server_key_iv: "5138a7fc243d7018de010d691d242072"
server_key_version: "encryptionkey@0"
I20260809 06:37:09.499145 381 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:37:09.502292 408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:09.503419 381 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:37:09.503572 381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "25481d447f0145738181c2f517e41310"
format_stamp: "Formatted at 2026-08-09 06:37:09 on dist-test-slave-cvwc"
server_key: "72d6dab2236e0401aa2ee2bcea892963"
server_key_iv: "5138a7fc243d7018de010d691d242072"
server_key_version: "encryptionkey@0"
I20260809 06:37:09.503759 381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:09.509155 381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:09.512594 381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:09.512848 381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:09.529488 381 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:42213
I20260809 06:37:09.529520 477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:42213 every 8 connection(s)
I20260809 06:37:09.530829 381 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:09.534281 483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:09.536275 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 381
I20260809 06:37:09.536460 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:09.536980 31033 external_mini_cluster.cc:1428] Setting key 58fcf09809442e2b8004c896c0a30349
I20260809 06:37:09.544517 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:09.538658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38961 (local address 127.30.78.126:42213)
0809 06:37:09.539445 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:09.539459 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:09.539505 (+ 46us) server_negotiation.cc:407] Connection header received
0809 06:37:09.541011 (+ 1506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:09.541036 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:09.541343 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:09.541653 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:09.542629 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:09.542636 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:09.542648 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:09.542663 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:09.542733 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:09.542761 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:09.542984 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:09.543162 (+ 178us) server_negotiation.cc:299] Negotiation successful
0809 06:37:09.543360 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":383,"threads_started":1}
I20260809 06:37:09.547189 483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310: Bootstrap starting.
I20260809 06:37:09.548151 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:09.550077 483 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:09.551193 483 log.cc:824] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:09.553692 483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310: No bootstrap required, opened a new log
I20260809 06:37:09.555979 489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:09.552158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43079 (local address 127.30.78.126:42213)
0809 06:37:09.552338 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:09.552345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:09.554245 (+ 1900us) server_negotiation.cc:407] Connection header received
0809 06:37:09.554406 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:09.554409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:09.554453 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:09.554527 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:09.555379 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:09.555386 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:09.555389 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:09.555406 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:09.555440 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:09.555456 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:09.555543 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:09.555663 (+ 120us) server_negotiation.cc:299] Negotiation successful
0809 06:37:09.555710 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:37:09.561298 483 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25481d447f0145738181c2f517e41310" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 42213 } }
I20260809 06:37:09.561607 483 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:37:09.561679 483 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25481d447f0145738181c2f517e41310, State: Initialized, Role: FOLLOWER
I20260809 06:37:09.562198 483 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25481d447f0145738181c2f517e41310" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 42213 } }
I20260809 06:37:09.562422 483 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:37:09.562559 483 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:37:09.562744 483 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:09.564862 483 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25481d447f0145738181c2f517e41310" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 42213 } }
I20260809 06:37:09.565310 483 leader_election.cc:302] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25481d447f0145738181c2f517e41310; no voters:
I20260809 06:37:09.565842 483 leader_election.cc:288] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:37:09.565958 498 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:09.566566 498 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [term 1 LEADER]: Becoming Leader. State: Replica: 25481d447f0145738181c2f517e41310, State: Running, Role: LEADER
I20260809 06:37:09.567051 498 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25481d447f0145738181c2f517e41310" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 42213 } }
I20260809 06:37:09.567767 483 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:09.569468 501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25481d447f0145738181c2f517e41310. Latest consensus state: current_term: 1 leader_uuid: "25481d447f0145738181c2f517e41310" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25481d447f0145738181c2f517e41310" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 42213 } } }
I20260809 06:37:09.569924 501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:09.570004 499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25481d447f0145738181c2f517e41310" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25481d447f0145738181c2f517e41310" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 42213 } } }
I20260809 06:37:09.570364 499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:09.574909 505 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:09.580027 505 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:09.588220 505 catalog_manager.cc:1347] Generated new cluster ID: 8c33d55e99b7437b920f6bd33b40cac1
I20260809 06:37:09.588310 505 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:09.596704 505 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:09.597126 505 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:09.606099 505 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25481d447f0145738181c2f517e41310: Generated new TSK 0
I20260809 06:37:09.606943 505 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:37:09.619148 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 381
W20260809 06:37:09.620265 472 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38961
W20260809 06:37:09.621011 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 381: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:37:09.621176 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 381
2026-08-09T06:37:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1955 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:37:09 dist-test-slave-cvwc krb5kdc[527](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:37:09 dist-test-slave-cvwc krb5kdc[527](info): set up 2 sockets
Aug 09 06:37:09 dist-test-slave-cvwc krb5kdc[527](info): commencing operation
krb5kdc: starting...
W20260809 06:37:10.846998 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.186s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:11 dist-test-slave-cvwc krb5kdc[527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:37:11.104808 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:45675
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:39769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:45675
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:11.431535 550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:11.431828 550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:11.431988 550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:11.439163 550 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:11.439287 550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:11.439373 550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:11.439464 550 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:11.439529 550 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:11.449093 550 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:39769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:45675
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:45675
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:11.450313 550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:11.451612 550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:11.463102 563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:11.463060 557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:11.463137 555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:11.463804 550 server_base.cc:1034] running on GCE node
I20260809 06:37:11.464570 550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:11.465916 550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:11.467142 550 hybrid_clock.cc:648] HybridClock initialized: now 1786257431467087 us; error 37 us; skew 500 ppm
I20260809 06:37:11.467497 550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:11 dist-test-slave-cvwc krb5kdc[527](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257431, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:11.473075 550 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:37:11.474550 550 webserver.cc:460] Webserver started at http://127.30.78.126:33609/ using document root <none> and password file <none>
I20260809 06:37:11.475193 550 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:11.475310 550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:11.475590 550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:11.478507 550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "001159ecf0884e6789bf34a52aefe9ab"
format_stamp: "Formatted at 2026-08-09 06:37:11 on dist-test-slave-cvwc"
server_key: "fc635fe072b20c062b668536a3ff26e1"
server_key_iv: "6e2f279a2520ad71e955913dab3f0bac"
server_key_version: "encryptionkey@0"
I20260809 06:37:11.479231 550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "001159ecf0884e6789bf34a52aefe9ab"
format_stamp: "Formatted at 2026-08-09 06:37:11 on dist-test-slave-cvwc"
server_key: "fc635fe072b20c062b668536a3ff26e1"
server_key_iv: "6e2f279a2520ad71e955913dab3f0bac"
server_key_version: "encryptionkey@0"
I20260809 06:37:11.484033 550 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:37:11.487192 570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:11.488356 550 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260809 06:37:11.488512 550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "001159ecf0884e6789bf34a52aefe9ab"
format_stamp: "Formatted at 2026-08-09 06:37:11 on dist-test-slave-cvwc"
server_key: "fc635fe072b20c062b668536a3ff26e1"
server_key_iv: "6e2f279a2520ad71e955913dab3f0bac"
server_key_version: "encryptionkey@0"
I20260809 06:37:11.488675 550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:11.508440 550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:11.512277 550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:11.512516 550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:11.529002 550 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:45675
I20260809 06:37:11.529026 648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:45675 every 8 connection(s)
I20260809 06:37:11.530251 550 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:11.533572 649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:11.537035 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 550
I20260809 06:37:11.537209 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:11.537753 31033 external_mini_cluster.cc:1428] Setting key d64975ca5898262c014caf1c89d50ccb
I20260809 06:37:11.544860 649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab: Bootstrap starting.
I20260809 06:37:11.547667 649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:11.548574 649 log.cc:824] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab: Log is configured to *not* fsync() on all Append() calls
Aug 09 06:37:11 dist-test-slave-cvwc krb5kdc[527](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:37:11.551302 649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab: No bootstrap required, opened a new log
I20260809 06:37:11.557955 656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:11.539445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54477 (local address 127.30.78.126:45675)
0809 06:37:11.540148 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:11.540159 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:11.540197 (+ 38us) server_negotiation.cc:407] Connection header received
0809 06:37:11.541822 (+ 1625us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:11.541843 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:11.542212 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:11.542548 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:11.543932 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:11.545210 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:11.546482 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:11.547091 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:11.547242 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:11.551163 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:11.551171 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:11.551183 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:11.551219 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:11.554215 (+ 2996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:11.554853 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:11.554859 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:11.554864 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:11.555023 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:11.555387 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:11.555390 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:11.555393 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:11.555894 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:11.556191 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:11.556619 (+ 428us) server_negotiation.cc:299] Negotiation successful
0809 06:37:11.556981 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":516,"thread_start_us":321,"threads_started":1}
I20260809 06:37:11.558866 649 raft_consensus.cc:348] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001159ecf0884e6789bf34a52aefe9ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45675 } }
I20260809 06:37:11.559218 649 raft_consensus.cc:374] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:37:11.559311 649 raft_consensus.cc:729] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 001159ecf0884e6789bf34a52aefe9ab, State: Initialized, Role: FOLLOWER
I20260809 06:37:11.559821 649 consensus_queue.cc:260] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001159ecf0884e6789bf34a52aefe9ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45675 } }
I20260809 06:37:11.560062 649 raft_consensus.cc:388] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:37:11.560202 649 raft_consensus.cc:482] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:37:11.560369 649 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:11.561298 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:11.563099 649 raft_consensus.cc:504] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001159ecf0884e6789bf34a52aefe9ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45675 } }
I20260809 06:37:11.563611 649 leader_election.cc:302] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 001159ecf0884e6789bf34a52aefe9ab; no voters:
I20260809 06:37:11.564229 649 leader_election.cc:288] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:37:11.564296 659 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:11.565977 659 raft_consensus.cc:686] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [term 1 LEADER]: Becoming Leader. State: Replica: 001159ecf0884e6789bf34a52aefe9ab, State: Running, Role: LEADER
I20260809 06:37:11.567200 659 consensus_queue.cc:237] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001159ecf0884e6789bf34a52aefe9ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45675 } }
I20260809 06:37:11.568648 649 sys_catalog.cc:564] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:11.570061 661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 001159ecf0884e6789bf34a52aefe9ab. Latest consensus state: current_term: 1 leader_uuid: "001159ecf0884e6789bf34a52aefe9ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001159ecf0884e6789bf34a52aefe9ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45675 } } }
I20260809 06:37:11.570401 661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:11.571417 663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "001159ecf0884e6789bf34a52aefe9ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "001159ecf0884e6789bf34a52aefe9ab" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 45675 } } }
I20260809 06:37:11.576062 663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:11.578238 670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:11.584352 670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:11.586084 656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:11.566461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41307 (local address 127.30.78.126:45675)
0809 06:37:11.566629 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:11.566635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:11.567481 (+ 846us) server_negotiation.cc:407] Connection header received
0809 06:37:11.567709 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:11.567715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:11.567784 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:11.567883 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:11.569688 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:11.570822 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:11.572706 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:11.576402 (+ 3696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:11.576539 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:11.579286 (+ 2747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:11.579294 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:11.579298 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:11.579338 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:11.582826 (+ 3488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:11.583633 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:11.583638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:11.583642 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:11.583788 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:11.584249 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:11.584253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:11.584256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:11.584773 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:11.585057 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:11.585443 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 06:37:11.585663 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:37:11.594703 670 catalog_manager.cc:1347] Generated new cluster ID: 301999066249478b998f3d231cd66de2
I20260809 06:37:11.594803 670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:11.605824 670 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:11.606963 670 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:11.615921 670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 001159ecf0884e6789bf34a52aefe9ab: Generated new TSK 0
I20260809 06:37:11.616576 670 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:37:11.623548 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 550
I20260809 06:37:11.624686 638 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:37:11.710587 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 550
2026-08-09T06:37:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2090 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:37:11 dist-test-slave-cvwc krb5kdc[697](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:37:11 dist-test-slave-cvwc krb5kdc[697](info): set up 2 sockets
Aug 09 06:37:11 dist-test-slave-cvwc krb5kdc[697](info): commencing operation
krb5kdc: starting...
W20260809 06:37:12.922067 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.005s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:13 dist-test-slave-cvwc krb5kdc[697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:37:13.192339 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:41075
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:32855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:41075
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:13.520702 717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:13.520992 717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:13.521135 717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:13.528432 717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:13.528570 717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:13.528658 717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:13.528769 717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:13.528842 717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:13.538648 717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:32855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:41075
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:41075
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:13.539800 717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:13.541033 717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:13.552381 727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:13.552378 733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:13.552435 730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:13.553208 717 server_base.cc:1034] running on GCE node
I20260809 06:37:13.554023 717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:13.555387 717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:13.556595 717 hybrid_clock.cc:648] HybridClock initialized: now 1786257433556545 us; error 38 us; skew 500 ppm
I20260809 06:37:13.556936 717 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:13 dist-test-slave-cvwc krb5kdc[697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257433, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:13.560056 717 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:37:13.561540 717 webserver.cc:460] Webserver started at http://127.30.78.126:46623/ using document root <none> and password file <none>
I20260809 06:37:13.562224 717 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:13.562354 717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:13.562657 717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:13.565784 717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "2a744b0fa63445918e1b5700193e95ae"
format_stamp: "Formatted at 2026-08-09 06:37:13 on dist-test-slave-cvwc"
server_key: "5b36031579b3640077416aeaf58c021c"
server_key_iv: "b1ba40cad3af0e9dad0bb698e2350f41"
server_key_version: "encryptionkey@0"
I20260809 06:37:13.566581 717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "2a744b0fa63445918e1b5700193e95ae"
format_stamp: "Formatted at 2026-08-09 06:37:13 on dist-test-slave-cvwc"
server_key: "5b36031579b3640077416aeaf58c021c"
server_key_iv: "b1ba40cad3af0e9dad0bb698e2350f41"
server_key_version: "encryptionkey@0"
I20260809 06:37:13.571643 717 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260809 06:37:13.575059 745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:13.576318 717 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:37:13.576485 717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "2a744b0fa63445918e1b5700193e95ae"
format_stamp: "Formatted at 2026-08-09 06:37:13 on dist-test-slave-cvwc"
server_key: "5b36031579b3640077416aeaf58c021c"
server_key_iv: "b1ba40cad3af0e9dad0bb698e2350f41"
server_key_version: "encryptionkey@0"
I20260809 06:37:13.576668 717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:13.589815 717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:13.593245 717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:13.593492 717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:13.610109 717 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:41075
I20260809 06:37:13.610146 815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:41075 every 8 connection(s)
I20260809 06:37:13.611364 717 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:13.614753 816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:13.615191 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 717
I20260809 06:37:13.615355 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:13.615787 31033 external_mini_cluster.cc:1428] Setting key 711c293f53994e2a5d6b40c0dfa62836
I20260809 06:37:13.627305 816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae: Bootstrap starting.
I20260809 06:37:13.628895 821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:13.617415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44055 (local address 127.30.78.126:41075)
0809 06:37:13.618160 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:13.618171 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:13.618216 (+ 45us) server_negotiation.cc:407] Connection header received
0809 06:37:13.620373 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:13.620395 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:13.620764 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:13.621093 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:13.621670 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:13.622924 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:13.624723 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:13.625370 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:13.625487 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:13.626732 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:13.626741 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:13.626755 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:13.627255 (+ 500us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:13.627333 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:13.627357 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:13.627461 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:13.627686 (+ 225us) server_negotiation.cc:299] Negotiation successful
0809 06:37:13.627918 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":380,"threads_started":1}
I20260809 06:37:13.630534 816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:13.631739 816 log.cc:824] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:13.632418 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:13.634620 816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae: No bootstrap required, opened a new log
I20260809 06:37:13.642609 816 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a744b0fa63445918e1b5700193e95ae" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41075 } }
I20260809 06:37:13.643042 816 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:37:13.643146 816 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a744b0fa63445918e1b5700193e95ae, State: Initialized, Role: FOLLOWER
I20260809 06:37:13.643786 816 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a744b0fa63445918e1b5700193e95ae" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41075 } }
I20260809 06:37:13.644083 816 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:37:13.644213 816 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:37:13.644392 816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:13.647107 816 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a744b0fa63445918e1b5700193e95ae" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41075 } }
I20260809 06:37:13.647614 816 leader_election.cc:302] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a744b0fa63445918e1b5700193e95ae; no voters:
I20260809 06:37:13.648316 821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:13.637226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39703 (local address 127.30.78.126:41075)
0809 06:37:13.637407 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:13.637412 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:13.642365 (+ 4953us) server_negotiation.cc:407] Connection header received
0809 06:37:13.642519 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:13.642524 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:13.642606 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:13.642720 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:13.643249 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:13.644271 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:13.645657 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:13.646333 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:13.646466 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:13.647514 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:13.647520 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:13.647525 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:13.647545 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:13.647589 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:13.647614 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:13.647748 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:13.647871 (+ 123us) server_negotiation.cc:299] Negotiation successful
0809 06:37:13.647955 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260809 06:37:13.648415 816 leader_election.cc:288] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:37:13.648571 835 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:13.649287 835 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [term 1 LEADER]: Becoming Leader. State: Replica: 2a744b0fa63445918e1b5700193e95ae, State: Running, Role: LEADER
I20260809 06:37:13.649950 835 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a744b0fa63445918e1b5700193e95ae" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41075 } }
I20260809 06:37:13.651232 816 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:13.652911 838 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a744b0fa63445918e1b5700193e95ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a744b0fa63445918e1b5700193e95ae" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41075 } } }
I20260809 06:37:13.652932 836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a744b0fa63445918e1b5700193e95ae. Latest consensus state: current_term: 1 leader_uuid: "2a744b0fa63445918e1b5700193e95ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a744b0fa63445918e1b5700193e95ae" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 41075 } } }
I20260809 06:37:13.653494 836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:13.653508 838 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:13.655260 845 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:13.660181 845 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:13.669628 845 catalog_manager.cc:1347] Generated new cluster ID: bae9dfbf0d41478d90d70db5f32de6eb
I20260809 06:37:13.669754 845 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:13.679301 845 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:13.680522 845 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:13.687247 845 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a744b0fa63445918e1b5700193e95ae: Generated new TSK 0
I20260809 06:37:13.687955 845 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:37:13.699203 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 717
W20260809 06:37:13.700201 807 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:44055
W20260809 06:37:13.700883 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 717: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:37:13.701012 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 717
2026-08-09T06:37:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1990 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:37:13 dist-test-slave-cvwc krb5kdc[875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:37:13 dist-test-slave-cvwc krb5kdc[875](info): set up 2 sockets
Aug 09 06:37:13 dist-test-slave-cvwc krb5kdc[875](info): commencing operation
krb5kdc: starting...
W20260809 06:37:14.914662 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:15 dist-test-slave-cvwc krb5kdc[875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:37:15.168304 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:37921
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:40841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:37921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:15.497092 892 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:15.497375 892 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:15.497488 892 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:15.504750 892 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:15.504863 892 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:15.504922 892 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:15.504990 892 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:15.505038 892 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:15.514701 892 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:40841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:37921
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:37921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:15.515877 892 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:15.517130 892 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:15.528595 899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:15.528643 902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:15.528666 898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:15.529654 892 server_base.cc:1034] running on GCE node
I20260809 06:37:15.530447 892 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:15.531710 892 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:15.532922 892 hybrid_clock.cc:648] HybridClock initialized: now 1786257435532872 us; error 43 us; skew 500 ppm
I20260809 06:37:15.533234 892 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:15 dist-test-slave-cvwc krb5kdc[875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257435, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:15.536149 892 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:37:15.537437 892 webserver.cc:460] Webserver started at http://127.30.78.126:36231/ using document root <none> and password file <none>
I20260809 06:37:15.538084 892 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:15.538199 892 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:15.538497 892 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:15.541299 892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "c76fbc3d24804135a3951e7c429c22e0"
format_stamp: "Formatted at 2026-08-09 06:37:15 on dist-test-slave-cvwc"
server_key: "4f9c9f8030ebf1256409ab2218f55851"
server_key_iv: "8b280900e31f4dac8b6f1229b2ca5127"
server_key_version: "encryptionkey@0"
I20260809 06:37:15.542055 892 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "c76fbc3d24804135a3951e7c429c22e0"
format_stamp: "Formatted at 2026-08-09 06:37:15 on dist-test-slave-cvwc"
server_key: "4f9c9f8030ebf1256409ab2218f55851"
server_key_iv: "8b280900e31f4dac8b6f1229b2ca5127"
server_key_version: "encryptionkey@0"
I20260809 06:37:15.546794 892 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260809 06:37:15.549934 912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:15.551086 892 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260809 06:37:15.551240 892 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "c76fbc3d24804135a3951e7c429c22e0"
format_stamp: "Formatted at 2026-08-09 06:37:15 on dist-test-slave-cvwc"
server_key: "4f9c9f8030ebf1256409ab2218f55851"
server_key_iv: "8b280900e31f4dac8b6f1229b2ca5127"
server_key_version: "encryptionkey@0"
I20260809 06:37:15.551415 892 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:15.556659 892 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:15.560592 892 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:15.560847 892 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:15.577306 892 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:37921
I20260809 06:37:15.577339 987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:37921 every 8 connection(s)
I20260809 06:37:15.578646 892 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:15.581089 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 892
I20260809 06:37:15.581275 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:15.581852 31033 external_mini_cluster.cc:1428] Setting key 65b6b5aa1ac1db0f4e23810832df727b
I20260809 06:37:15.582513 988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:15.589097 993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:15.583511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60683 (local address 127.30.78.126:37921)
0809 06:37:15.584242 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:15.584253 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:15.584292 (+ 39us) server_negotiation.cc:407] Connection header received
0809 06:37:15.585816 (+ 1524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:15.585838 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:15.586166 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:15.586476 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:15.587451 (+ 975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:15.587457 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:15.587469 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:15.587485 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:15.587557 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:15.587576 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:15.587731 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:15.587829 (+ 98us) server_negotiation.cc:299] Negotiation successful
0809 06:37:15.588014 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":326,"threads_started":1}
I20260809 06:37:15.592605 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:15.595479 988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0: Bootstrap starting.
I20260809 06:37:15.598910 993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:15.596682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41551 (local address 127.30.78.126:37921)
0809 06:37:15.596861 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:15.596875 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:15.597212 (+ 337us) server_negotiation.cc:407] Connection header received
0809 06:37:15.597363 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:15.597366 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:15.597411 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:15.597482 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:15.598338 (+ 856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:15.598342 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:15.598345 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0809 06:37:15.598358 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:15.598394 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0809 06:37:15.598408 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:15.598504 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:15.598613 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 06:37:15.598651 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260809 06:37:15.598915 988 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:15.599987 988 log.cc:824] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:15.602370 988 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0: No bootstrap required, opened a new log
I20260809 06:37:15.609436 988 raft_consensus.cc:348] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76fbc3d24804135a3951e7c429c22e0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37921 } }
I20260809 06:37:15.609803 988 raft_consensus.cc:374] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260809 06:37:15.609911 988 raft_consensus.cc:729] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c76fbc3d24804135a3951e7c429c22e0, State: Initialized, Role: FOLLOWER
I20260809 06:37:15.610467 988 consensus_queue.cc:260] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76fbc3d24804135a3951e7c429c22e0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37921 } }
I20260809 06:37:15.610672 988 raft_consensus.cc:388] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260809 06:37:15.610802 988 raft_consensus.cc:482] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260809 06:37:15.610966 988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:15.612982 988 raft_consensus.cc:504] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76fbc3d24804135a3951e7c429c22e0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37921 } }
I20260809 06:37:15.613427 988 leader_election.cc:302] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c76fbc3d24804135a3951e7c429c22e0; no voters:
I20260809 06:37:15.613987 988 leader_election.cc:288] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260809 06:37:15.614096 1006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:15.615483 1006 raft_consensus.cc:686] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [term 1 LEADER]: Becoming Leader. State: Replica: c76fbc3d24804135a3951e7c429c22e0, State: Running, Role: LEADER
I20260809 06:37:15.616000 988 sys_catalog.cc:564] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:15.615957 1006 consensus_queue.cc:237] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76fbc3d24804135a3951e7c429c22e0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37921 } }
I20260809 06:37:15.618930 1009 sys_catalog.cc:455] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c76fbc3d24804135a3951e7c429c22e0. Latest consensus state: current_term: 1 leader_uuid: "c76fbc3d24804135a3951e7c429c22e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76fbc3d24804135a3951e7c429c22e0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37921 } } }
I20260809 06:37:15.618943 1007 sys_catalog.cc:455] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c76fbc3d24804135a3951e7c429c22e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c76fbc3d24804135a3951e7c429c22e0" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 37921 } } }
I20260809 06:37:15.619375 1007 sys_catalog.cc:458] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:15.619390 1009 sys_catalog.cc:458] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:15.626152 1020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:15.632426 1020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:15.640769 1020 catalog_manager.cc:1347] Generated new cluster ID: b58d9669ca64486890f509e3d08c3abf
I20260809 06:37:15.640863 1020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:15.655514 1020 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:15.655867 1020 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:15.668706 1020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c76fbc3d24804135a3951e7c429c22e0: Generated new TSK 0
I20260809 06:37:15.669443 1020 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:37:15.676236 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 892
W20260809 06:37:15.677697 981 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60683
W20260809 06:37:15.678408 31033 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 892: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260809 06:37:15.678570 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 892
2026-08-09T06:37:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1979 ms)
[----------] 18 tests from AuthTokenIssuingTest (36367 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:37:15 dist-test-slave-cvwc krb5kdc[1039](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:37:15 dist-test-slave-cvwc krb5kdc[1039](info): set up 2 sockets
Aug 09 06:37:15 dist-test-slave-cvwc krb5kdc[1039](info): commencing operation
krb5kdc: starting...
W20260809 06:37:16.898298 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.006s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:17 dist-test-slave-cvwc krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:37:17.158809 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:34789
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:34635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:34789,127.30.78.125:46525,127.30.78.124:33125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:17.483985 1058 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:37:17.484306 1058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:17.484404 1058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:17.484520 1058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:17.491611 1058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:17.491695 1058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:17.491791 1058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:17.491849 1058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:17.491935 1058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:17.501477 1058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:34635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:34789,127.30.78.125:46525,127.30.78.124:33125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:34789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:17.502713 1058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:17.503999 1058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:17.514797 1063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:17.514940 1064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:17.514973 1068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:17.515791 1058 server_base.cc:1034] running on GCE node
I20260809 06:37:17.516460 1058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:17.517623 1058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:17.518834 1058 hybrid_clock.cc:648] HybridClock initialized: now 1786257437518773 us; error 32 us; skew 500 ppm
I20260809 06:37:17.519124 1058 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:17 dist-test-slave-cvwc krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257437, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:17.525000 1058 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:37:17.526302 1058 webserver.cc:460] Webserver started at http://127.30.78.126:40941/ using document root <none> and password file <none>
I20260809 06:37:17.526914 1058 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:17.527019 1058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:17.527360 1058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:17.530335 1058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "a9659380ca934ed38e7c8117d062f5a7"
format_stamp: "Formatted at 2026-08-09 06:37:17 on dist-test-slave-cvwc"
server_key: "9ea0e5c892722dd077cca0965ad59479"
server_key_iv: "e5b849bb942ee580a6e87068dfa98902"
server_key_version: "encryptionkey@0"
I20260809 06:37:17.531087 1058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "a9659380ca934ed38e7c8117d062f5a7"
format_stamp: "Formatted at 2026-08-09 06:37:17 on dist-test-slave-cvwc"
server_key: "9ea0e5c892722dd077cca0965ad59479"
server_key_iv: "e5b849bb942ee580a6e87068dfa98902"
server_key_version: "encryptionkey@0"
I20260809 06:37:17.535754 1058 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260809 06:37:17.539000 1077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:17.540171 1058 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260809 06:37:17.540316 1058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "a9659380ca934ed38e7c8117d062f5a7"
format_stamp: "Formatted at 2026-08-09 06:37:17 on dist-test-slave-cvwc"
server_key: "9ea0e5c892722dd077cca0965ad59479"
server_key_iv: "e5b849bb942ee580a6e87068dfa98902"
server_key_version: "encryptionkey@0"
I20260809 06:37:17.540512 1058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:17.556262 1058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:17.559886 1058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:17.560120 1058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:17.577028 1058 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:34789
I20260809 06:37:17.577037 1156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:34789 every 8 connection(s)
I20260809 06:37:17.578330 1058 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:17.581887 1157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:17.584476 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1058
I20260809 06:37:17.584699 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:17.585493 31033 external_mini_cluster.cc:1428] Setting key b48acfe2b85807fa5de68abc70ffbe53
I20260809 06:37:17.590013 1157 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:37:17 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257437, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:37:17.611147 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.593214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:34789 (local address 127.0.0.1:42040)
0809 06:37:17.594029 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.594080 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:17.596038 (+ 1958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:17.596912 (+ 874us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:17.596918 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:17.597431 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:17.597788 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:17.597806 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:17.599491 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:17.599495 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:17.600519 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:17.600531 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:17.601379 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:17.601386 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:17.601573 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:17.602174 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:17.602195 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:17.604391 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:17.607247 (+ 2856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:17.607258 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:17.607269 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:17.607625 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:17.607995 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:17.608000 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:17.608004 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:17.608148 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:17.608836 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:17.608843 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:17.609024 (+ 181us) client_negotiation.cc:769] Sending connection context
0809 06:37:17.609225 (+ 201us) client_negotiation.cc:240] Negotiation successful
0809 06:37:17.609694 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"mutex_wait_us":45,"thread_start_us":334,"threads_started":1}
I20260809 06:37:17.611178 1161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.594445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42040 (local address 127.30.78.126:34789)
0809 06:37:17.595100 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:17.595109 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:17.595157 (+ 48us) server_negotiation.cc:407] Connection header received
0809 06:37:17.596394 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:17.596401 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:17.596683 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:17.596874 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:17.597992 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:17.599347 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:17.600648 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:17.601165 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:17.601337 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:17.604586 (+ 3249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:17.604594 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:17.604604 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:17.604631 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:17.607129 (+ 2498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:17.607750 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:17.607756 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:17.607758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:17.607893 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:17.608254 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:17.608257 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:17.608259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:17.608699 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:17.608882 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:17.609394 (+ 512us) server_negotiation.cc:299] Negotiation successful
0809 06:37:17.609836 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":149,"server-negotiator.queue_time_us":459,"thread_start_us":302,"threads_started":1}
I20260809 06:37:17.614255 1157 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.30.78.125@KRBTEST.COM; defaulting to no policy
I20260809 06:37:17.615459 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.615005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48646)
0809 06:37:17.615163 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.615322 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260809 06:37:17.615788 1080 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
I20260809 06:37:17.617247 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.616923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48658)
0809 06:37:17.617044 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.617116 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 06:37:17.617446 1157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:46525: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab.
Entry for principal kudu/127.30.78.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab.
I20260809 06:37:17.648959 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.125:46525
--webserver_interface=127.30.78.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab
--principal=kudu/127.30.78.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:34635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:34789,127.30.78.125:46525,127.30.78.124:33125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:37:17.666746 1157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } attempt: 1
I20260809 06:37:17.668016 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.667472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48674)
0809 06:37:17.667736 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.667869 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260809 06:37:17.669087 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.668690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48686)
0809 06:37:17.668829 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.668929 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 06:37:17.669276 1157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:46525: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
I20260809 06:37:17.737524 1157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } attempt: 2
I20260809 06:37:17.738790 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.738349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48698)
0809 06:37:17.738548 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.738645 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 06:37:17.739864 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.739470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48712)
0809 06:37:17.739633 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.739709 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260809 06:37:17.740082 1157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:46525: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
I20260809 06:37:17.831338 1157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } attempt: 3
I20260809 06:37:17.832544 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.832116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48724)
0809 06:37:17.832309 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.832413 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 06:37:17.833653 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.833205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48728)
0809 06:37:17.833390 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.833481 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260809 06:37:17.833945 1157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:46525: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
W20260809 06:37:17.973070 1165 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:37:17.973395 1165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:17.973495 1165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:17.973592 1165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260809 06:37:17.977188 1157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } attempt: 4
I20260809 06:37:17.978423 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.977888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48744)
0809 06:37:17.978184 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.978289 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153}
I20260809 06:37:17.979399 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:17.979046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48758)
0809 06:37:17.979185 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:17.979277 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 06:37:17.979590 1157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:46525: Network error: Client connection negotiation failed: client connection to 127.30.78.125:46525: connect: Connection refused (error 111)
W20260809 06:37:17.981068 1165 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:17.981158 1165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:17.981251 1165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:17.981323 1165 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:17.981405 1165 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:17.991096 1165 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:34635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:34789,127.30.78.125:46525,127.30.78.124:33125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab
--principal=kudu/127.30.78.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.125:46525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.78.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:17.992326 1165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:17.993636 1165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:18.004923 1180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:18.004995 1174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:18.004974 1176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:18.005980 1165 server_base.cc:1034] running on GCE node
I20260809 06:37:18.006690 1165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:18.007985 1165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:18.009213 1165 hybrid_clock.cc:648] HybridClock initialized: now 1786257438009146 us; error 46 us; skew 500 ppm
I20260809 06:37:18.009526 1165 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257438, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:18.012621 1165 init.cc:377] Logged in from keytab as kudu/127.30.78.125@KRBTEST.COM (short username kudu)
I20260809 06:37:18.014092 1165 webserver.cc:460] Webserver started at http://127.30.78.125:45213/ using document root <none> and password file <none>
I20260809 06:37:18.014746 1165 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:18.014864 1165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:18.015158 1165 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:18.018040 1165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/data/instance:
uuid: "2ac62a595ee2498abe98262dd0df7f90"
format_stamp: "Formatted at 2026-08-09 06:37:18 on dist-test-slave-cvwc"
server_key: "eeec1280782b6f0a7a13708f2ddbb26c"
server_key_iv: "e29a6c0e70a396932b03e0c0d3fd5595"
server_key_version: "encryptionkey@0"
I20260809 06:37:18.018826 1165 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/wal/instance:
uuid: "2ac62a595ee2498abe98262dd0df7f90"
format_stamp: "Formatted at 2026-08-09 06:37:18 on dist-test-slave-cvwc"
server_key: "eeec1280782b6f0a7a13708f2ddbb26c"
server_key_iv: "e29a6c0e70a396932b03e0c0d3fd5595"
server_key_version: "encryptionkey@0"
I20260809 06:37:18.023643 1165 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260809 06:37:18.026976 1196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:18.028189 1165 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260809 06:37:18.028342 1165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/wal
uuid: "2ac62a595ee2498abe98262dd0df7f90"
format_stamp: "Formatted at 2026-08-09 06:37:18 on dist-test-slave-cvwc"
server_key: "eeec1280782b6f0a7a13708f2ddbb26c"
server_key_iv: "e29a6c0e70a396932b03e0c0d3fd5595"
server_key_version: "encryptionkey@0"
I20260809 06:37:18.028570 1165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:18.045876 1165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:18.049760 1165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:18.049998 1165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:18.066617 1165 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.125:46525
I20260809 06:37:18.066650 1267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.125:46525 every 8 connection(s)
I20260809 06:37:18.067884 1165 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
I20260809 06:37:18.071346 1268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:18.074663 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1165
I20260809 06:37:18.074828 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-1/wal/instance
I20260809 06:37:18.075229 31033 external_mini_cluster.cc:1428] Setting key c4c638aa5201452050395aa507f19846
I20260809 06:37:18.077575 1268 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257438, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:37:18.097791 1161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.080006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42054 (local address 127.30.78.126:34789)
0809 06:37:18.080210 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.080217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.081285 (+ 1068us) server_negotiation.cc:407] Connection header received
0809 06:37:18.083561 (+ 2276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.083565 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.083636 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.083722 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.085496 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.086209 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.088113 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.088692 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.088818 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.092303 (+ 3485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.092307 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.092311 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.092342 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.094927 (+ 2585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.095699 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.095703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.095705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.095817 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.096258 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.096261 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.096263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.096522 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.096629 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.097353 (+ 724us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.097533 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:37:18.099107 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.080387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:34789 (local address 127.0.0.1:42054)
0809 06:37:18.081116 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.081163 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:18.083290 (+ 2127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:18.083981 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:18.083991 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:18.084635 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:18.085349 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.085372 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.086364 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.086369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.087980 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.087993 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.088866 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.088878 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.089068 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.089659 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:18.089681 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:18.092092 (+ 2411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:18.095065 (+ 2973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.095072 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.095086 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.095608 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.095914 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.095918 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.095922 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.096167 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.096640 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:18.096648 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:18.097023 (+ 375us) client_negotiation.cc:769] Sending connection context
0809 06:37:18.097322 (+ 299us) client_negotiation.cc:240] Negotiation successful
0809 06:37:18.097809 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":265,"threads_started":1}
I20260809 06:37:18.100656 1268 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.30.78.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.124@KRBTEST.COM" created.
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257438, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:37:18.114414 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.101462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48762)
0809 06:37:18.101633 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.101655 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:18.101773 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:18.102798 (+ 1025us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:18.102801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:18.103135 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:18.103265 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.103273 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.105179 (+ 1906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.105183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.106062 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.106074 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.106845 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.106849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.106967 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.107456 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:18.107473 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:18.109323 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:18.112175 (+ 2852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.112180 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.112184 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.112505 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.112833 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.112837 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.112841 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.112969 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.113499 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:18.113504 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:18.113635 (+ 131us) client_negotiation.cc:769] Sending connection context
0809 06:37:18.113779 (+ 144us) client_negotiation.cc:240] Negotiation successful
0809 06:37:18.114034 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260809 06:37:18.114491 1274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.101595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48762 (local address 127.30.78.125:46525)
0809 06:37:18.102324 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.102333 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.102365 (+ 32us) server_negotiation.cc:407] Connection header received
0809 06:37:18.102419 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.102427 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.102648 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.102804 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.103426 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.105056 (+ 1630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.106196 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.106720 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.106819 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.109503 (+ 2684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.109514 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.109524 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.109556 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.112063 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.112620 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.112626 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.112628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.112735 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.113064 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.113069 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.113072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.113379 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.113576 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.113933 (+ 357us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.114137 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":400,"threads_started":1}
I20260809 06:37:18.116832 1268 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:37:18.117998 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.117523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43020)
0809 06:37:18.117699 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.117856 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 06:37:18.118233 1201 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
I20260809 06:37:18.119777 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.119470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43026)
0809 06:37:18.119613 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.119686 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 06:37:18.119961 1268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:33125: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab.
Entry for principal kudu/127.30.78.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab.
I20260809 06:37:18.138705 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.124:33125
--webserver_interface=127.30.78.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab
--principal=kudu/127.30.78.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:34635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:34789,127.30.78.125:46525,127.30.78.124:33125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:37:18.169258 1268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } attempt: 1
I20260809 06:37:18.170375 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.169931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43040)
0809 06:37:18.170119 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.170220 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260809 06:37:18.171411 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.171081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43042)
0809 06:37:18.171230 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.171300 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 06:37:18.171600 1268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:33125: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
I20260809 06:37:18.239780 1268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } attempt: 2
I20260809 06:37:18.240787 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.240358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43050)
0809 06:37:18.240546 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.240635 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 06:37:18.241796 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.241436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43066)
0809 06:37:18.241571 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.241639 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260809 06:37:18.241994 1268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:33125: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
I20260809 06:37:18.278836 1157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } attempt: 5
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257437, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:37:18.291709 1274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.279692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48774 (local address 127.30.78.125:46525)
0809 06:37:18.279870 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.279876 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.279901 (+ 25us) server_negotiation.cc:407] Connection header received
0809 06:37:18.280116 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.280119 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.280200 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.280287 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.281092 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.281839 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.282970 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.283408 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.283520 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.286784 (+ 3264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.286790 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.286793 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.286826 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.289245 (+ 2419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.289908 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.289914 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.289917 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.290037 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.290389 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.290394 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.290396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.290664 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.290794 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.291195 (+ 401us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.291409 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260809 06:37:18.291711 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.279592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48774)
0809 06:37:18.279812 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.279834 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:18.279982 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:18.280336 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:18.280341 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:18.280740 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:18.280933 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.280942 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.281965 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.281970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.282815 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.282828 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.283568 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.283574 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.283759 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.284328 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:18.284346 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:18.286596 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:18.289369 (+ 2773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.289374 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.289379 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.289801 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.290142 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.290147 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.290151 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.290282 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.290779 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:18.290784 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:18.290930 (+ 146us) client_negotiation.cc:769] Sending connection context
0809 06:37:18.291078 (+ 148us) client_negotiation.cc:240] Negotiation successful
0809 06:37:18.291347 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 06:37:18.292774 1157 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:37:18.293921 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.293534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43074)
0809 06:37:18.293688 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.293786 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260809 06:37:18.294785 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.294516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43076)
0809 06:37:18.294621 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.294693 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260809 06:37:18.295019 1157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:33125: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
I20260809 06:37:18.333180 1268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } attempt: 3
I20260809 06:37:18.334233 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.333779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43078)
0809 06:37:18.333980 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.334081 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 06:37:18.335273 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.334865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43082)
0809 06:37:18.335088 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.335166 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260809 06:37:18.335445 1268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:33125: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
I20260809 06:37:18.346261 1157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } attempt: 1
I20260809 06:37:18.347220 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.346824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43098)
0809 06:37:18.346991 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.347069 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 06:37:18.348172 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.347871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43108)
0809 06:37:18.348002 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.348070 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260809 06:37:18.348363 1157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:33125: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
I20260809 06:37:18.416564 1157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } attempt: 2
I20260809 06:37:18.417845 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.417304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43110)
0809 06:37:18.417553 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.417640 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260809 06:37:18.419443 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.418591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43114)
0809 06:37:18.419252 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.419335 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":540}
W20260809 06:37:18.419704 1157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:33125: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
W20260809 06:37:18.463531 1277 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:37:18.463836 1277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:18.463917 1277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:18.463999 1277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:18.471204 1277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:18.471290 1277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:18.471350 1277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:18.471400 1277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:18.471459 1277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:18.478641 1268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } attempt: 4
I20260809 06:37:18.479827 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.479249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43128)
0809 06:37:18.479505 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.479623 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260809 06:37:18.480890 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.480517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43142)
0809 06:37:18.480667 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.480756 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 06:37:18.481119 1268 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:33125: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
I20260809 06:37:18.481573 1277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:34635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:34789,127.30.78.125:46525,127.30.78.124:33125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab
--principal=kudu/127.30.78.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.124:33125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.78.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:18.482839 1277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:18.484127 1277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:18.495316 1288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:18.495282 1286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:18.495541 1285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:18.496093 1277 server_base.cc:1034] running on GCE node
I20260809 06:37:18.496826 1277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:18.498159 1277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:18.499363 1277 hybrid_clock.cc:648] HybridClock initialized: now 1786257438499302 us; error 31 us; skew 500 ppm
I20260809 06:37:18.499668 1277 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257438, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:18.502664 1277 init.cc:377] Logged in from keytab as kudu/127.30.78.124@KRBTEST.COM (short username kudu)
I20260809 06:37:18.503933 1277 webserver.cc:460] Webserver started at http://127.30.78.124:36947/ using document root <none> and password file <none>
I20260809 06:37:18.504563 1277 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:18.504662 1277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:18.504956 1277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:18.507797 1277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/data/instance:
uuid: "4bc723b9f1b145d093464f8c840749b2"
format_stamp: "Formatted at 2026-08-09 06:37:18 on dist-test-slave-cvwc"
server_key: "14e461f97688c792bbf78ed15574611c"
server_key_iv: "41be4c436f61cd27358d5cefa2d033f2"
server_key_version: "encryptionkey@0"
I20260809 06:37:18.508548 1277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/wal/instance:
uuid: "4bc723b9f1b145d093464f8c840749b2"
format_stamp: "Formatted at 2026-08-09 06:37:18 on dist-test-slave-cvwc"
server_key: "14e461f97688c792bbf78ed15574611c"
server_key_iv: "41be4c436f61cd27358d5cefa2d033f2"
server_key_version: "encryptionkey@0"
I20260809 06:37:18.513234 1277 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.002s
I20260809 06:37:18.516453 1305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:18.517644 1277 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:37:18.517805 1277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/wal
uuid: "4bc723b9f1b145d093464f8c840749b2"
format_stamp: "Formatted at 2026-08-09 06:37:18 on dist-test-slave-cvwc"
server_key: "14e461f97688c792bbf78ed15574611c"
server_key_iv: "41be4c436f61cd27358d5cefa2d033f2"
server_key_version: "encryptionkey@0"
I20260809 06:37:18.517994 1277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:18.525906 1157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } attempt: 3
I20260809 06:37:18.526930 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.526497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43144)
0809 06:37:18.526666 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.526752 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260809 06:37:18.527853 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.527510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43156)
0809 06:37:18.527681 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.527756 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260809 06:37:18.528048 1157 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:33125: Network error: Client connection negotiation failed: client connection to 127.30.78.124:33125: connect: Connection refused (error 111)
I20260809 06:37:18.549332 1277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:18.553421 1277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:18.553658 1277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:18.570861 1277 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.124:33125
I20260809 06:37:18.570894 1389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.124:33125 every 8 connection(s)
I20260809 06:37:18.572140 1277 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
I20260809 06:37:18.573433 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1277
I20260809 06:37:18.573616 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786257083636440-31033-0/minicluster-data/master-2/wal/instance
I20260809 06:37:18.574178 31033 external_mini_cluster.cc:1428] Setting key 3ece4bd35ca2edb891dda4fb7f5e4b36
I20260809 06:37:18.576818 1390 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
I20260809 06:37:18.586025 1390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:37:18.595211 1395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.576054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43160 (local address 127.30.78.124:33125)
0809 06:37:18.576831 (+ 777us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.576842 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.576886 (+ 44us) server_negotiation.cc:407] Connection header received
0809 06:37:18.578536 (+ 1650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.578558 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.578907 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.579232 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.580651 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.581991 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.583222 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.583889 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.584061 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.587852 (+ 3791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.587863 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.587879 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.587925 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.591335 (+ 3410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.591976 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.591983 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.591989 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.592165 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.592533 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.592537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.592539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.593049 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.593319 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.593793 (+ 474us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.594205 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":332,"threads_started":1}
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257438, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:37:18.602653 1396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.588694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:34789 (local address 127.0.0.1:42056)
0809 06:37:18.589411 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.589449 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:18.589607 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:18.589974 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:18.589981 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:18.590648 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:18.590914 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.590923 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.591886 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.591890 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.592946 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.592958 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.593697 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.593704 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.593875 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.594438 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:18.594453 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:18.596484 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:18.600044 (+ 3560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.600055 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.600062 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.600642 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.601005 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.601009 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.601013 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.601165 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.601808 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:18.601816 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:18.601983 (+ 167us) client_negotiation.cc:769] Sending connection context
0809 06:37:18.602143 (+ 160us) client_negotiation.cc:240] Negotiation successful
0809 06:37:18.602363 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":351,"threads_started":1}
I20260809 06:37:18.602864 1161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.588673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42056 (local address 127.30.78.126:34789)
0809 06:37:18.588848 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.588854 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.589542 (+ 688us) server_negotiation.cc:407] Connection header received
0809 06:37:18.589767 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.589772 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.589836 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.589915 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.591048 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.591723 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.593078 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.593513 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.593617 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.596658 (+ 3041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.596662 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.596666 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.596697 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.599917 (+ 3220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.600754 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.600758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.600760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.600911 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.601279 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.601283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.601286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.601628 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.601802 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.602266 (+ 464us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.602487 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260809 06:37:18.604017 1390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257438, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:37:18.613273 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.597847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42058 (local address 127.30.78.126:34789)
0809 06:37:18.598409 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.598413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.598431 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:37:18.598479 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.598482 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.598534 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.598611 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.600086 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.601160 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.602725 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.603656 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.603764 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.607769 (+ 4005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.607776 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.607780 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.607816 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.610538 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.611360 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.611364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.611367 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.611504 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.611822 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.611827 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.611831 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.612173 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.612425 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.612682 (+ 257us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.612915 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":234,"threads_started":1}
I20260809 06:37:18.617139 1274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.604720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48782 (local address 127.30.78.125:46525)
0809 06:37:18.604889 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.604894 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.604912 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:37:18.605036 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.605041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.605106 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.605183 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.605878 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.606669 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.607824 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.608448 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.608563 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.611426 (+ 2863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.611432 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.611437 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.611476 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.614546 (+ 3070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.615336 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.615341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.615344 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.615506 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.615923 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.615928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.615930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.616186 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.616300 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.616719 (+ 419us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.616886 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260809 06:37:18.617250 1396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.604647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:46525 (local address 127.0.0.1:48782)
0809 06:37:18.604805 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.604823 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:18.604925 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:18.605216 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:18.605220 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:18.605570 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:18.605696 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.605704 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.606805 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.606809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.607699 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.607711 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.608595 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.608601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.608779 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.609217 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:18.609232 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:18.611241 (+ 2009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:18.614674 (+ 3433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.614700 (+ 26us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.614703 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.615179 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.615631 (+ 452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.615634 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.615636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.615796 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.616310 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:18.616316 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:18.616499 (+ 183us) client_negotiation.cc:769] Sending connection context
0809 06:37:18.616662 (+ 163us) client_negotiation.cc:240] Negotiation successful
0809 06:37:18.616945 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 06:37:18.618263 1390 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257438, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
I20260809 06:37:18.630800 1399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.614912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48792 (local address 127.30.78.125:46525)
0809 06:37:18.615515 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.615520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.615541 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:37:18.615583 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.615587 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.615656 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.615730 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.617237 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.618363 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.619852 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.620384 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.620505 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.625072 (+ 4567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.625080 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.625085 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.625120 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.628255 (+ 3135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.628882 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.628887 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.628890 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.629016 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.629385 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.629389 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.629392 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.629742 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.629938 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.630226 (+ 288us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.630448 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":239,"threads_started":1}
I20260809 06:37:18.631199 1396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.619007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43164)
0809 06:37:18.619169 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.619186 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:18.619275 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:18.619522 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:18.619527 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:18.619948 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:18.620080 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.620088 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.621132 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.621137 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.622150 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.622165 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.623077 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.623081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.623233 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.623687 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:18.623702 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:18.625802 (+ 2100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:18.628918 (+ 3116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.628922 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.628924 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.629341 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.629686 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.629689 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.629692 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.629864 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.630408 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:18.630413 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:18.630562 (+ 149us) client_negotiation.cc:769] Sending connection context
0809 06:37:18.630672 (+ 110us) client_negotiation.cc:240] Negotiation successful
0809 06:37:18.630853 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 06:37:18.631508 1395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.619158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43164 (local address 127.30.78.124:33125)
0809 06:37:18.619284 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.619288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.619301 (+ 13us) server_negotiation.cc:407] Connection header received
0809 06:37:18.619359 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.619362 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.619411 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.619479 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.620200 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.621028 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.622277 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.622935 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.623061 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.625976 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.625982 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.625986 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.626022 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.628784 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.629444 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.629449 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.629452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.629587 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.629987 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.629991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.629993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.630280 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.630417 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.630809 (+ 392us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.631052 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260809 06:37:18.635671 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:18.637044 1390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2: Bootstrap starting.
I20260809 06:37:18.640228 1390 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:18.638285 1121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a9659380ca934ed38e7c8117d062f5a7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42058
I20260809 06:37:18.641273 1390 log.cc:824] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:18.644273 1390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2: No bootstrap required, opened a new log
I20260809 06:37:18.654874 1390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } }
I20260809 06:37:18.655298 1390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc723b9f1b145d093464f8c840749b2, State: Initialized, Role: FOLLOWER
I20260809 06:37:18.655803 1390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } }
I20260809 06:37:18.656724 1401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:18.657039 1401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:18.658000 1390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 06:37:18.667151 1416 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:37:18.667299 1416 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:37:18.665160 1277 master_runner.cc:186] Error getting master registration for 127.30.78.126:34789: OK, instance_id { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" instance_seqno: 1786257437572135 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:37:18.672410 1277 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 06:37:18.705245 1157 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } attempt: 4
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257437, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
I20260809 06:37:18.720574 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.706007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43176)
0809 06:37:18.706238 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.706261 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:18.706398 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:18.706769 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:18.706774 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:18.707203 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:18.707374 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.707386 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.708413 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.708419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.709374 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.709388 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.710163 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.710169 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.710385 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.710951 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:18.710969 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:18.713636 (+ 2667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:18.717683 (+ 4047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.717688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.717692 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.718236 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.718629 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.718634 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.718638 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.718821 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.719525 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:18.719531 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:18.719724 (+ 193us) client_negotiation.cc:769] Sending connection context
0809 06:37:18.719891 (+ 167us) client_negotiation.cc:240] Negotiation successful
0809 06:37:18.720179 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 06:37:18.720599 1395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.706102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43176 (local address 127.30.78.124:33125)
0809 06:37:18.706295 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.706299 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.706318 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:37:18.706541 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.706544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.706607 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.706697 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.707530 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.708269 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.709519 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.710015 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.710134 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.713861 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.713869 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.713875 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.713924 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.717542 (+ 3618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.718350 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.718356 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.718360 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.718518 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.718945 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.718950 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.718953 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.719397 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.719544 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.720026 (+ 482us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.720249 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260809 06:37:18.725286 1157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7: Bootstrap starting.
I20260809 06:37:18.728729 1157 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:18.729760 1157 log.cc:824] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:18.732519 1157 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7: No bootstrap required, opened a new log
I20260809 06:37:18.737452 1157 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } }
I20260809 06:37:18.737795 1157 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9659380ca934ed38e7c8117d062f5a7, State: Initialized, Role: FOLLOWER
I20260809 06:37:18.738241 1157 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } }
I20260809 06:37:18.739106 1421 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:18.739507 1421 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:18.740231 1157 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:18.740338 1121 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 06:37:18.740531 1121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:18.743846 1121 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } }
I20260809 06:37:18.747284 1348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a9659380ca934ed38e7c8117d062f5a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4bc723b9f1b145d093464f8c840749b2"
I20260809 06:37:18.747792 1348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [term 0 FOLLOWER]: Advancing to term 1
W20260809 06:37:18.752592 1435 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:37:18.752792 1435 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:37:18.755066 1348 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9659380ca934ed38e7c8117d062f5a7 in term 1.
I20260809 06:37:18.751469 1058 master_runner.cc:186] Error getting master registration for 127.30.78.125:46525: OK, instance_id { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" instance_seqno: 1786257438061857 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:37:18.763053 1121 leader_election.cc:288] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac62a595ee2498abe98262dd0df7f90 (127.30.78.125:46525), 4bc723b9f1b145d093464f8c840749b2 (127.30.78.124:33125)
I20260809 06:37:18.763103 1083 leader_election.cc:302] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4bc723b9f1b145d093464f8c840749b2, a9659380ca934ed38e7c8117d062f5a7; no voters:
I20260809 06:37:18.763622 1421 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:18.763746 1058 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 06:37:18.764333 1421 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [term 1 LEADER]: Becoming Leader. State: Replica: a9659380ca934ed38e7c8117d062f5a7, State: Running, Role: LEADER
I20260809 06:37:18.764931 1421 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } }
I20260809 06:37:18.775650 1438 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9659380ca934ed38e7c8117d062f5a7. Latest consensus state: current_term: 1 leader_uuid: "a9659380ca934ed38e7c8117d062f5a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:18.776109 1438 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:18.780323 1268 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } attempt: 5
Aug 09 06:37:18 dist-test-slave-cvwc krb5kdc[1039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257438, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
I20260809 06:37:18.791437 1446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:18.793574 1446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:18.800933 1271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.781019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:33125 (local address 127.0.0.1:43190)
0809 06:37:18.781232 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:18.781255 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:18.781405 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:18.782149 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:18.782153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:18.782694 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:18.782931 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.782944 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.784555 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.784561 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.786063 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:18.786080 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.787241 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.787246 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:18.787476 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.788171 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:18.788197 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:18.790926 (+ 2729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:18.795966 (+ 5040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.795970 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.795974 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.796744 (+ 770us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.797493 (+ 749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:18.797498 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:18.797501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:18.797767 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:18.798887 (+ 1120us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:18.798893 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:18.799139 (+ 246us) client_negotiation.cc:769] Sending connection context
0809 06:37:18.799341 (+ 202us) client_negotiation.cc:240] Negotiation successful
0809 06:37:18.799785 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260809 06:37:18.802702 1395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.781427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43190 (local address 127.30.78.124:33125)
0809 06:37:18.781618 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.781624 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.781643 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:37:18.781736 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.781742 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.781830 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.781951 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.783143 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.784381 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.786233 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.786900 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.787025 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.791110 (+ 4085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.791117 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.791122 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.791161 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.795749 (+ 4588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.796991 (+ 1242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.796996 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.796999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.797302 (+ 303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.798013 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.798018 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.798021 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.798684 (+ 663us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.800427 (+ 1743us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.800963 (+ 536us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.802088 (+ 1125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:37:18.807374 1348 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [term 1 FOLLOWER]: Refusing update from remote peer a9659380ca934ed38e7c8117d062f5a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260809 06:37:18.807734 1316 tablet.cc:2369] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:37:18.808426 1438 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:37:18.809903 1268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90: Bootstrap starting.
W20260809 06:37:18.812671 1087 tablet.cc:2369] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:37:18.816150 1268 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:18.818593 1268 log.cc:824] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:18.837119 1401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9659380ca934ed38e7c8117d062f5a7. Latest consensus state: current_term: 1 leader_uuid: "a9659380ca934ed38e7c8117d062f5a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:18.837478 1401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:18.839815 1421 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a9659380ca934ed38e7c8117d062f5a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:18.840417 1421 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:18.842140 1446 catalog_manager.cc:1347] Generated new cluster ID: ab3538ff671e4683acfb046df522b9f2
I20260809 06:37:18.842242 1446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:18.842833 1268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90: No bootstrap required, opened a new log
I20260809 06:37:18.860733 1401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a9659380ca934ed38e7c8117d062f5a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:18.861033 1401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:18.873744 1395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.816489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43196 (local address 127.30.78.124:33125)
0809 06:37:18.819500 (+ 3011us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.819506 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.831798 (+ 12292us) server_negotiation.cc:407] Connection header received
0809 06:37:18.832823 (+ 1025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.832829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.832955 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.833029 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.843686 (+ 10657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.844710 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.849513 (+ 4803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.850232 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.850335 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.860372 (+ 10037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.860379 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.860384 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.860434 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.864215 (+ 3781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.869479 (+ 5264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.869485 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.869488 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.869635 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.870749 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.870754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.870757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.871173 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.871419 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.873038 (+ 1619us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.873311 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2881}
I20260809 06:37:18.875834 1399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.816498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48806 (local address 127.30.78.125:46525)
0809 06:37:18.816695 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.816701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.832720 (+ 16019us) server_negotiation.cc:407] Connection header received
0809 06:37:18.841433 (+ 8713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.841438 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.841520 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.841594 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.845837 (+ 4243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.846900 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.851347 (+ 4447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.851969 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.852064 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.865100 (+ 13036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.865106 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.865111 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.865150 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.868698 (+ 3548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.870136 (+ 1438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.870141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.870144 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.870299 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.871918 (+ 1619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.871924 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.871927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.872260 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.872485 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.875290 (+ 2805us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.875511 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260809 06:37:18.876603 1446 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:18.878417 1446 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:18.885901 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:18.816903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42060 (local address 127.30.78.126:34789)
0809 06:37:18.817087 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:18.817093 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:18.821326 (+ 4233us) server_negotiation.cc:407] Connection header received
0809 06:37:18.821923 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:18.821930 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:18.822012 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:18.822090 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:18.832535 (+ 10445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.833615 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.856706 (+ 23091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:18.857395 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:18.857492 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:18.869299 (+ 11807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:18.869306 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:18.869311 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:18.869352 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:18.873100 (+ 3748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.880505 (+ 7405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.880511 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.880515 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.880667 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:18.882098 (+ 1431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:18.882104 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:18.882108 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:18.882478 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:18.882705 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:18.885245 (+ 2540us) server_negotiation.cc:299] Negotiation successful
0809 06:37:18.885534 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260809 06:37:18.888954 1446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7: Generated new TSK 0
I20260809 06:37:18.890002 1446 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260809 06:37:18.900892 1268 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } }
I20260809 06:37:18.901537 1268 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac62a595ee2498abe98262dd0df7f90, State: Initialized, Role: FOLLOWER
I20260809 06:37:18.902318 1268 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } }
I20260809 06:37:18.914347 1464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:18.914795 1464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:18.917306 1231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:18.920899 1231 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [term 1 FOLLOWER]: Refusing update from remote peer a9659380ca934ed38e7c8117d062f5a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:37:18.921571 1232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a9659380ca934ed38e7c8117d062f5a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2ac62a595ee2498abe98262dd0df7f90"
I20260809 06:37:18.924830 1232 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9659380ca934ed38e7c8117d062f5a7 in term 1.
I20260809 06:37:18.925608 1421 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:37:18.926119 1268 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:18.964308 1464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9659380ca934ed38e7c8117d062f5a7. Latest consensus state: current_term: 1 leader_uuid: "a9659380ca934ed38e7c8117d062f5a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:18.964365 1470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a9659380ca934ed38e7c8117d062f5a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:18.964669 1464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:18.964902 1470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90 [sys.catalog]: This master's current role is: FOLLOWER
W20260809 06:37:19.000931 31033 mini_kdc.cc:348] Time spent kdestroy: real 0.103s user 0.000s sys 0.027s
I20260809 06:37:19.013324 1495 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260809 06:37:19.040710 1398 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.027819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42064 (local address 127.30.78.126:34789)
0809 06:37:19.027991 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.027996 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.038730 (+ 10734us) server_negotiation.cc:407] Connection header received
0809 06:37:19.039068 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.039075 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.039172 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.039247 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.040460 (+ 1213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42064: BlockingRecv error: recv got EOF from 127.0.0.1:42064 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 06:37:19.042006 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.027814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48820 (local address 127.30.78.125:46525)
0809 06:37:19.027990 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.027996 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.039255 (+ 11259us) server_negotiation.cc:407] Connection header received
0809 06:37:19.040313 (+ 1058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.040319 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.040424 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.040496 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.041687 (+ 1191us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48820: BlockingRecv error: recv got EOF from 127.0.0.1:48820 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 06:37:19.042832 1395 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.029857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43202 (local address 127.30.78.124:33125)
0809 06:37:19.030051 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.030062 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.039826 (+ 9764us) server_negotiation.cc:407] Connection header received
0809 06:37:19.039981 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.039986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.040090 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.040190 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.042596 (+ 2406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43202: BlockingRecv error: recv got EOF from 127.0.0.1:43202 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260809 06:37:19.052410 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.050568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48826 (local address 127.30.78.125:46525)
0809 06:37:19.050727 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.050733 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.050752 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:37:19.051009 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.051016 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.051150 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.051225 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.052194 (+ 969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48826: BlockingRecv error: recv got EOF from 127.0.0.1:48826 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260809 06:37:19.060093 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.058245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48830 (local address 127.30.78.125:46525)
0809 06:37:19.058436 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.058441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.058474 (+ 33us) server_negotiation.cc:407] Connection header received
0809 06:37:19.058564 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.058568 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.058653 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.058757 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.059830 (+ 1073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48830: BlockingRecv error: recv got EOF from 127.0.0.1:48830 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 06:37:19.092438 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.066423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48832 (local address 127.30.78.125:46525)
0809 06:37:19.066588 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.066594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.090403 (+ 23809us) server_negotiation.cc:407] Connection header received
0809 06:37:19.090619 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.090625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.090731 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.090863 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.092186 (+ 1323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48832: BlockingRecv error: recv got EOF from 127.0.0.1:48832 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260809 06:37:19.103585 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.100631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48836 (local address 127.30.78.125:46525)
0809 06:37:19.100834 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.100840 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.102258 (+ 1418us) server_negotiation.cc:407] Connection header received
0809 06:37:19.102433 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.102439 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.102529 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.102640 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.103354 (+ 714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48836: BlockingRecv error: recv got EOF from 127.0.0.1:48836 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
W20260809 06:37:19.117440 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.115398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48844 (local address 127.30.78.125:46525)
0809 06:37:19.115556 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.115562 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.116055 (+ 493us) server_negotiation.cc:407] Connection header received
0809 06:37:19.116226 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.116231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.116324 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.116431 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.117240 (+ 809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48844: BlockingRecv error: recv got EOF from 127.0.0.1:48844 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260809 06:37:19.139120 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.136695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48860 (local address 127.30.78.125:46525)
0809 06:37:19.136863 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.136869 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.137390 (+ 521us) server_negotiation.cc:407] Connection header received
0809 06:37:19.137613 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.137619 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.137706 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.137833 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.138880 (+ 1047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48860: BlockingRecv error: recv got EOF from 127.0.0.1:48860 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260809 06:37:19.176757 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.174480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.30.78.125:46525)
0809 06:37:19.174688 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.174694 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.175259 (+ 565us) server_negotiation.cc:407] Connection header received
0809 06:37:19.175454 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.175461 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.175560 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.175668 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.176510 (+ 842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48876: BlockingRecv error: recv got EOF from 127.0.0.1:48876 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260809 06:37:19.252966 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.250823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48886 (local address 127.30.78.125:46525)
0809 06:37:19.251043 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.251049 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.251382 (+ 333us) server_negotiation.cc:407] Connection header received
0809 06:37:19.251623 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.251627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.251708 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.251820 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.252687 (+ 867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48886: BlockingRecv error: recv got EOF from 127.0.0.1:48886 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260809 06:37:19.386601 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.384790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48894 (local address 127.30.78.125:46525)
0809 06:37:19.384988 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.384993 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.385319 (+ 326us) server_negotiation.cc:407] Connection header received
0809 06:37:19.385490 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.385493 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.385565 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.385663 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.386377 (+ 714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48894: BlockingRecv error: recv got EOF from 127.0.0.1:48894 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260809 06:37:19.412155 1421 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a9659380ca934ed38e7c8117d062f5a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9659380ca934ed38e7c8117d062f5a7" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 34789 } } peers { permanent_uuid: "2ac62a595ee2498abe98262dd0df7f90" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 46525 } } peers { permanent_uuid: "4bc723b9f1b145d093464f8c840749b2" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 33125 } } }
I20260809 06:37:19.412534 1421 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9659380ca934ed38e7c8117d062f5a7 [sys.catalog]: This master's current role is: LEADER
W20260809 06:37:19.647787 1399 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:19.646145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48908 (local address 127.30.78.125:46525)
0809 06:37:19.646318 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:19.646324 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:19.646595 (+ 271us) server_negotiation.cc:407] Connection header received
0809 06:37:19.646780 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:19.646784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:19.646857 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:19.646962 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:19.647589 (+ 627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48908: BlockingRecv error: recv got EOF from 127.0.0.1:48908 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
I20260809 06:37:19.669283 1416 catalog_manager.cc:1259] Loaded cluster ID: ab3538ff671e4683acfb046df522b9f2
I20260809 06:37:19.669394 1416 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2: loading cluster ID for follower catalog manager: success
I20260809 06:37:19.671949 1416 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2: acquiring CA information for follower catalog manager: success
I20260809 06:37:19.673677 1416 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4bc723b9f1b145d093464f8c840749b2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:37:20.017557 1495 catalog_manager.cc:1259] Loaded cluster ID: ab3538ff671e4683acfb046df522b9f2
I20260809 06:37:20.017693 1495 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90: loading cluster ID for follower catalog manager: success
I20260809 06:37:20.020298 1495 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90: acquiring CA information for follower catalog manager: success
I20260809 06:37:20.022372 1495 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2ac62a595ee2498abe98262dd0df7f90: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:37:20.170400 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:20.163234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48912 (local address 127.30.78.125:46525)
0809 06:37:20.163865 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:20.163871 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:20.164157 (+ 286us) server_negotiation.cc:407] Connection header received
0809 06:37:20.164368 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:20.164372 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:20.164552 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:20.164667 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:20.165174 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.166023 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.168006 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.168424 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.168513 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:20.169097 (+ 584us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:20.169757 (+ 660us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:20.169873 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:20.169982 (+ 109us) server_negotiation.cc:299] Negotiation successful
0809 06:37:20.170056 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":485,"thread_start_us":292,"threads_started":1}
I20260809 06:37:20.185885 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:20.179546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43216 (local address 127.30.78.124:33125)
0809 06:37:20.180187 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:20.180192 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:20.180209 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:37:20.180308 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:20.180311 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:20.180457 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:20.180596 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:20.181008 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.181705 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.183598 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.184029 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.184129 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:20.184702 (+ 573us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:20.185233 (+ 531us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:20.185345 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:20.185462 (+ 117us) server_negotiation.cc:299] Negotiation successful
0809 06:37:20.185531 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":546,"thread_start_us":440,"threads_started":1}
I20260809 06:37:20.215279 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:20.193386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43230 (local address 127.30.78.124:33125)
0809 06:37:20.193543 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:20.193549 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:20.208767 (+ 15218us) server_negotiation.cc:407] Connection header received
0809 06:37:20.208936 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:20.208941 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:20.209040 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:20.209130 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:20.209913 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.210928 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.213116 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.213774 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.213864 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:20.214508 (+ 644us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:20.214636 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:20.214694 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:20.214908 (+ 214us) server_negotiation.cc:299] Negotiation successful
0809 06:37:20.214996 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260809 06:37:20.215411 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:20.193366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48928 (local address 127.30.78.125:46525)
0809 06:37:20.193544 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:20.193549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:20.207532 (+ 13983us) server_negotiation.cc:407] Connection header received
0809 06:37:20.208103 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:20.208110 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:20.208216 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:20.208280 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:20.209023 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.210322 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.213238 (+ 2916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.213892 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.214006 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:20.214645 (+ 639us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:20.214767 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:20.214825 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:20.215051 (+ 226us) server_negotiation.cc:299] Negotiation successful
0809 06:37:20.215133 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260809 06:37:20.219872 1605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:20.193084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42070 (local address 127.30.78.126:34789)
0809 06:37:20.206910 (+ 13826us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:20.206917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:20.213113 (+ 6196us) server_negotiation.cc:407] Connection header received
0809 06:37:20.213340 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:20.213348 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:20.213557 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:20.213755 (+ 198us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:20.214548 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.215927 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.218019 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:20.218427 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:20.218549 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:20.218989 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:20.219289 (+ 300us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:20.219391 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:20.219532 (+ 141us) server_negotiation.cc:299] Negotiation successful
0809 06:37:20.219616 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13659,"thread_start_us":14789,"threads_started":1}
I20260809 06:37:20.224901 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1058
I20260809 06:37:20.226052 1150 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:37:20.335865 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1058
I20260809 06:37:20.362886 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1165
I20260809 06:37:20.364198 1257 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:37:20.472911 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1165
I20260809 06:37:20.496201 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1277
I20260809 06:37:20.497241 1380 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:37:20.603863 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1277
2026-08-09T06:37:20Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4927 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 09 06:37:20 dist-test-slave-cvwc krb5kdc[1617](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 09 06:37:20 dist-test-slave-cvwc krb5kdc[1617](info): set up 2 sockets
Aug 09 06:37:20 dist-test-slave-cvwc krb5kdc[1617](info): commencing operation
krb5kdc: starting...
W20260809 06:37:21.825695 31033 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.001s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/test-user.keytab.
Aug 09 06:37:21 dist-test-slave-cvwc krb5kdc[1617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-09T06:37:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-09T06:37:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.78.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
Entry for principal kudu/127.30.78.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab.
I20260809 06:37:22.090245 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33859
--webserver_interface=127.30.78.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:33859,127.30.78.125:35025,127.30.78.124:40537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260809 06:37:22.419348 1640 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:37:22.419685 1640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:22.419812 1640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:22.419934 1640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:22.427152 1640 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:22.427248 1640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:22.427343 1640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:22.427416 1640 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:22.427518 1640 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:22.437270 1640 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:33859,127.30.78.125:35025,127.30.78.124:40537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.126.keytab
--principal=kudu/127.30.78.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.126:33859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.78.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:22.438656 1640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:22.440047 1640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:22.451912 1648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:22.451944 1650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:22.452008 1647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:22.452813 1640 server_base.cc:1034] running on GCE node
I20260809 06:37:22.453585 1640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:22.454998 1640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:22.456244 1640 hybrid_clock.cc:648] HybridClock initialized: now 1786257442456170 us; error 36 us; skew 500 ppm
I20260809 06:37:22.456586 1640 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:22 dist-test-slave-cvwc krb5kdc[1617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257442, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:22.459781 1640 init.cc:377] Logged in from keytab as kudu/127.30.78.126@KRBTEST.COM (short username kudu)
I20260809 06:37:22.461252 1640 webserver.cc:460] Webserver started at http://127.30.78.126:35207/ using document root <none> and password file <none>
I20260809 06:37:22.462018 1640 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:22.462132 1640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:22.462472 1640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:22.465538 1640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/data/instance:
uuid: "b5c45bbbd09d4492a207e1391d30b04d"
format_stamp: "Formatted at 2026-08-09 06:37:22 on dist-test-slave-cvwc"
server_key: "1018f24e1893fcc87bdd4b6c0cb43384"
server_key_iv: "b0c03b4cfd8d647dcec687a0caf87f40"
server_key_version: "encryptionkey@0"
I20260809 06:37:22.466444 1640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/wal/instance:
uuid: "b5c45bbbd09d4492a207e1391d30b04d"
format_stamp: "Formatted at 2026-08-09 06:37:22 on dist-test-slave-cvwc"
server_key: "1018f24e1893fcc87bdd4b6c0cb43384"
server_key_iv: "b0c03b4cfd8d647dcec687a0caf87f40"
server_key_version: "encryptionkey@0"
I20260809 06:37:22.471789 1640 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260809 06:37:22.475263 1660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:22.476627 1640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260809 06:37:22.476850 1640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/wal
uuid: "b5c45bbbd09d4492a207e1391d30b04d"
format_stamp: "Formatted at 2026-08-09 06:37:22 on dist-test-slave-cvwc"
server_key: "1018f24e1893fcc87bdd4b6c0cb43384"
server_key_iv: "b0c03b4cfd8d647dcec687a0caf87f40"
server_key_version: "encryptionkey@0"
I20260809 06:37:22.477064 1640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:22.498495 1640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:22.502319 1640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:22.502591 1640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:22.520684 1640 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.126:33859
I20260809 06:37:22.520690 1742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.126:33859 every 8 connection(s)
I20260809 06:37:22.522063 1640 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/data/info.pb
I20260809 06:37:22.524966 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1640
I20260809 06:37:22.525135 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-0/wal/instance
I20260809 06:37:22.525602 31033 external_mini_cluster.cc:1428] Setting key 3a32d86432b9d6e251f76146269e19ae
I20260809 06:37:22.525856 1743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:22.532009 1743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:37:22 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257442, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.78.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.125@KRBTEST.COM" created.
I20260809 06:37:22.560804 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.534982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33859 (local address 127.0.0.1:43958)
0809 06:37:22.535858 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.535909 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:22.538280 (+ 2371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:22.539245 (+ 965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:22.539256 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:22.539999 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:22.540469 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:22.540494 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:22.542063 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:22.542069 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:22.543688 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:22.543722 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:22.544644 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:22.544652 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:22.544844 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:22.550667 (+ 5823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:22.550702 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:22.553469 (+ 2767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:22.556586 (+ 3117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:22.556596 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:22.556605 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:22.557017 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:22.557524 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:22.557528 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:22.557530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:22.557745 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:22.558527 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:22.558535 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:22.558747 (+ 212us) client_negotiation.cc:769] Sending connection context
0809 06:37:22.558971 (+ 224us) client_negotiation.cc:240] Negotiation successful
0809 06:37:22.559562 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":155,"thread_start_us":352,"threads_started":1}
I20260809 06:37:22.560835 1747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.534982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43958 (local address 127.30.78.126:33859)
0809 06:37:22.536640 (+ 1658us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:22.536646 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:22.536687 (+ 41us) server_negotiation.cc:407] Connection header received
0809 06:37:22.538652 (+ 1965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:22.538660 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:22.538977 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:22.539148 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:22.540685 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:22.541902 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:22.543881 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:22.544392 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:22.544516 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:22.553702 (+ 9186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:22.553730 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:22.553746 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:22.553776 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:22.556466 (+ 2690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:22.557141 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:22.557147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:22.557150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:22.557380 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:22.557871 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:22.557875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:22.557877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:22.558369 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:22.558572 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:22.559125 (+ 553us) server_negotiation.cc:299] Negotiation successful
0809 06:37:22.559405 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1469,"spinlock_wait_cycles":27904,"thread_start_us":1244,"threads_started":1}
I20260809 06:37:22.563838 1743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:37:22.564925 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.564537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:39694)
0809 06:37:22.564697 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.564816 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260809 06:37:22.565217 1668 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
I20260809 06:37:22.566681 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.566360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:39706)
0809 06:37:22.566487 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.566552 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 06:37:22.566902 1743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:35025: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab.
Entry for principal kudu/127.30.78.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab.
I20260809 06:37:22.588469 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.125:35025
--webserver_interface=127.30.78.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab
--principal=kudu/127.30.78.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:33859,127.30.78.125:35025,127.30.78.124:40537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:37:22.616230 1743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } attempt: 1
I20260809 06:37:22.617465 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.616995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:39714)
0809 06:37:22.617188 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.617331 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 06:37:22.618432 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.618107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:39724)
0809 06:37:22.618232 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.618300 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 06:37:22.618637 1743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:35025: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
I20260809 06:37:22.686841 1743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } attempt: 2
I20260809 06:37:22.687997 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.687534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:38674)
0809 06:37:22.687753 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.687847 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260809 06:37:22.689014 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.688661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:38690)
0809 06:37:22.688799 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.688869 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260809 06:37:22.689213 1743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:35025: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
I20260809 06:37:22.780432 1743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } attempt: 3
I20260809 06:37:22.781478 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.781037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:38698)
0809 06:37:22.781245 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.781339 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260809 06:37:22.782485 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.782159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:38700)
0809 06:37:22.782285 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.782354 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260809 06:37:22.782672 1743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:35025: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
W20260809 06:37:22.915668 1755 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:37:22.915977 1755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:22.916074 1755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:22.916183 1755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:22.923218 1755 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:22.923302 1755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:22.923388 1755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:22.923449 1755 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:22.923532 1755 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:22.925871 1743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } attempt: 4
I20260809 06:37:22.927037 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.926513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:38704)
0809 06:37:22.926804 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.926901 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260809 06:37:22.927994 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:22.927658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:38712)
0809 06:37:22.927785 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:22.927866 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260809 06:37:22.928195 1743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.125:35025: Network error: Client connection negotiation failed: client connection to 127.30.78.125:35025: connect: Connection refused (error 111)
I20260809 06:37:22.933408 1755 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:33859,127.30.78.125:35025,127.30.78.124:40537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.125.keytab
--principal=kudu/127.30.78.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.125:35025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.78.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:22.934580 1755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:22.935801 1755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:22.946380 1761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:22.946445 1762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:22.947177 1764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:22.947454 1755 server_base.cc:1034] running on GCE node
I20260809 06:37:22.948233 1755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:22.949498 1755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:22.950709 1755 hybrid_clock.cc:648] HybridClock initialized: now 1786257442950627 us; error 60 us; skew 500 ppm
I20260809 06:37:22.951006 1755 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:22 dist-test-slave-cvwc krb5kdc[1617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257442, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:22.954030 1755 init.cc:377] Logged in from keytab as kudu/127.30.78.125@KRBTEST.COM (short username kudu)
I20260809 06:37:22.955605 1755 webserver.cc:460] Webserver started at http://127.30.78.125:37515/ using document root <none> and password file <none>
I20260809 06:37:22.956233 1755 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:22.956332 1755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:22.956645 1755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:22.959462 1755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/data/instance:
uuid: "ecf689e04cb54d14b9a9b2c99064c6fe"
format_stamp: "Formatted at 2026-08-09 06:37:22 on dist-test-slave-cvwc"
server_key: "17a7ec8ba8377ca3ad3c7f5ed9650af5"
server_key_iv: "c0db93726917bb62fdd042a3c15d7994"
server_key_version: "encryptionkey@0"
I20260809 06:37:22.960203 1755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/wal/instance:
uuid: "ecf689e04cb54d14b9a9b2c99064c6fe"
format_stamp: "Formatted at 2026-08-09 06:37:22 on dist-test-slave-cvwc"
server_key: "17a7ec8ba8377ca3ad3c7f5ed9650af5"
server_key_iv: "c0db93726917bb62fdd042a3c15d7994"
server_key_version: "encryptionkey@0"
I20260809 06:37:22.964943 1755 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260809 06:37:22.968137 1773 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:22.969338 1755 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260809 06:37:22.969502 1755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/wal
uuid: "ecf689e04cb54d14b9a9b2c99064c6fe"
format_stamp: "Formatted at 2026-08-09 06:37:22 on dist-test-slave-cvwc"
server_key: "17a7ec8ba8377ca3ad3c7f5ed9650af5"
server_key_iv: "c0db93726917bb62fdd042a3c15d7994"
server_key_version: "encryptionkey@0"
I20260809 06:37:22.969686 1755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:22.986915 1755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:22.991961 1755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:22.992184 1755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:23.008558 1755 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.125:35025
I20260809 06:37:23.008564 1863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.125:35025 every 8 connection(s)
I20260809 06:37:23.009802 1755 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/data/info.pb
I20260809 06:37:23.012883 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1755
I20260809 06:37:23.013048 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-1/wal/instance
I20260809 06:37:23.013348 1864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:23.013484 31033 external_mini_cluster.cc:1428] Setting key 3d8dc6a1821d568987165574f34f20df
I20260809 06:37:23.019505 1864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257442, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:37:23.039516 1747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.021921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33744 (local address 127.30.78.126:33859)
0809 06:37:23.022089 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.022094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.023352 (+ 1258us) server_negotiation.cc:407] Connection header received
0809 06:37:23.025139 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.025145 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.025222 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.025312 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.026900 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.027581 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.029583 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.030034 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.030135 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.033960 (+ 3825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.033965 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.033969 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.034001 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.036513 (+ 2512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.037347 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.037351 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.037354 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.037468 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.037903 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.037906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.037908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.038174 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.038285 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.039062 (+ 777us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.039228 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260809 06:37:23.040585 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.022502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33859 (local address 127.0.0.1:33744)
0809 06:37:23.023201 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.023237 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:23.024867 (+ 1630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:23.025540 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:23.025547 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:23.026089 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:23.026711 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.026733 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.027744 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.027749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.029447 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.029462 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.030247 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.030253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.030513 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.031173 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:23.031207 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:23.033743 (+ 2536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:23.036647 (+ 2904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.036655 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.036670 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.037250 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.037558 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.037562 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.037566 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.037803 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.038300 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:23.038307 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:23.038710 (+ 403us) client_negotiation.cc:769] Sending connection context
0809 06:37:23.038982 (+ 272us) client_negotiation.cc:240] Negotiation successful
0809 06:37:23.039465 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":297,"threads_started":1}
I20260809 06:37:23.042229 1864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.30.78.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.78.124@KRBTEST.COM" created.
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257442, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:37:23.055636 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.042924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:38728)
0809 06:37:23.043071 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.043090 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:23.043184 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:23.044197 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:23.044203 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:23.044541 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:23.044669 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.044677 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.046027 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.046033 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.046886 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.046898 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.047638 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.047643 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.047817 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.048343 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:23.048366 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:23.050442 (+ 2076us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:23.053308 (+ 2866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.053312 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.053315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.053763 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.054096 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.054100 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.054103 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.054275 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.054798 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:23.054803 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:23.054939 (+ 136us) client_negotiation.cc:769] Sending connection context
0809 06:37:23.055072 (+ 133us) client_negotiation.cc:240] Negotiation successful
0809 06:37:23.055307 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260809 06:37:23.055699 1869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.043173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38728 (local address 127.30.78.125:35025)
0809 06:37:23.043776 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.043782 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.043806 (+ 24us) server_negotiation.cc:407] Connection header received
0809 06:37:23.043850 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.043856 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.044038 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.044167 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.044808 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.045890 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.047011 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.047509 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.047619 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.050633 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.050643 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.050655 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.050682 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.053184 (+ 2502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.053881 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.053887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.053889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.054000 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.054375 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.054379 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.054381 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.054682 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.054832 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.055170 (+ 338us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.055398 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":471,"thread_start_us":317,"threads_started":1}
I20260809 06:37:23.058226 1864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:37:23.059252 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.058839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49350)
0809 06:37:23.059014 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.059116 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260809 06:37:23.059495 1778 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
I20260809 06:37:23.060847 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.060577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49362)
0809 06:37:23.060685 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.060753 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 06:37:23.061046 1864 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:40537: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.78.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab.
Entry for principal kudu/127.30.78.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab.
I20260809 06:37:23.079993 31033 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklYlngI/build/asan/bin/kudu
/tmp/dist-test-tasklYlngI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.124:40537
--webserver_interface=127.30.78.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab
--principal=kudu/127.30.78.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.78.84:33225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.78.126:33859,127.30.78.125:35025,127.30.78.124:40537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260809 06:37:23.110332 1864 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } attempt: 1
I20260809 06:37:23.111475 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.111031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49366)
0809 06:37:23.111224 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.111326 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260809 06:37:23.112375 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.112041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49382)
0809 06:37:23.112191 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.112266 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 06:37:23.112569 1864 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:40537: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
I20260809 06:37:23.180795 1864 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } attempt: 2
I20260809 06:37:23.182017 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.181507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49384)
0809 06:37:23.181701 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.181826 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260809 06:37:23.182958 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.182620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49394)
0809 06:37:23.182760 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.182832 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260809 06:37:23.183171 1864 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:40537: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
I20260809 06:37:23.227418 1743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } attempt: 5
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257442, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:37:23.241010 1869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.228202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38734 (local address 127.30.78.125:35025)
0809 06:37:23.228373 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.228378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.228399 (+ 21us) server_negotiation.cc:407] Connection header received
0809 06:37:23.228614 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.228618 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.228682 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.228765 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.229779 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.230465 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.232095 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.232511 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.232597 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.236089 (+ 3492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.236094 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.236097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.236128 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.238580 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.239189 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.239193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.239196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.239311 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.239670 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.239675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.239678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.239960 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.240090 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.240477 (+ 387us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.240680 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260809 06:37:23.241009 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.228053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:38734)
0809 06:37:23.228301 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.228326 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:23.228476 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:23.228833 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:23.228838 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:23.229356 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:23.229594 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.229608 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.230601 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.230607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.231963 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.231981 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.232687 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.232694 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.232937 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.233535 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:23.233557 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:23.235900 (+ 2343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:23.238704 (+ 2804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.238710 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.238715 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.239076 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.239423 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.239428 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.239433 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.239566 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.240076 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:23.240080 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:23.240233 (+ 153us) client_negotiation.cc:769] Sending connection context
0809 06:37:23.240355 (+ 122us) client_negotiation.cc:240] Negotiation successful
0809 06:37:23.240648 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260809 06:37:23.242014 1743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:37:23.243014 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.242646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49402)
0809 06:37:23.242812 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.242884 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260809 06:37:23.243880 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.243605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49412)
0809 06:37:23.243711 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.243786 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260809 06:37:23.244145 1743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:40537: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
I20260809 06:37:23.274358 1864 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } attempt: 3
I20260809 06:37:23.275528 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.274936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49426)
0809 06:37:23.275171 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.275308 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260809 06:37:23.276670 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.276178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49432)
0809 06:37:23.276417 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.276514 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
W20260809 06:37:23.276897 1864 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:40537: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
I20260809 06:37:23.295329 1743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } attempt: 1
I20260809 06:37:23.296460 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.296030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49436)
0809 06:37:23.296209 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.296297 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260809 06:37:23.297505 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.297096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49444)
0809 06:37:23.297303 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.297383 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260809 06:37:23.297749 1743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:40537: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
I20260809 06:37:23.365952 1743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } attempt: 2
I20260809 06:37:23.367054 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.366610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49446)
0809 06:37:23.366806 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.366896 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 06:37:23.368017 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.367721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49454)
0809 06:37:23.367843 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.367919 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260809 06:37:23.368221 1743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:40537: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
W20260809 06:37:23.404035 1874 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260809 06:37:23.404340 1874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260809 06:37:23.404445 1874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260809 06:37:23.404552 1874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260809 06:37:23.411803 1874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260809 06:37:23.411878 1874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260809 06:37:23.411949 1874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260809 06:37:23.412015 1874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260809 06:37:23.412101 1874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260809 06:37:23.420126 1864 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } attempt: 4
I20260809 06:37:23.421267 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.420732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49468)
0809 06:37:23.420971 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.421075 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 06:37:23.421914 1874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.78.84:33225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.78.126:33859,127.30.78.125:35025,127.30.78.124:40537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/krb5kdc/kudu_127.30.78.124.keytab
--principal=kudu/127.30.78.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.78.124:40537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.78.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 09 Aug 2026 05:36:50 UTC on ccycloud.quasar-ooxuuz.root.comops.site
build id 4575857
ASAN enabled
I20260809 06:37:23.422240 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.421873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49478)
0809 06:37:23.422029 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.422113 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260809 06:37:23.422434 1864 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:40537: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
I20260809 06:37:23.423225 1874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260809 06:37:23.424407 1874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260809 06:37:23.435250 1887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:23.435330 1883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260809 06:37:23.435300 1884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260809 06:37:23.436065 1874 server_base.cc:1034] running on GCE node
I20260809 06:37:23.436749 1874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260809 06:37:23.438004 1874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260809 06:37:23.439214 1874 hybrid_clock.cc:648] HybridClock initialized: now 1786257443439147 us; error 40 us; skew 500 ppm
I20260809 06:37:23.439497 1874 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257443, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260809 06:37:23.442474 1874 init.cc:377] Logged in from keytab as kudu/127.30.78.124@KRBTEST.COM (short username kudu)
I20260809 06:37:23.443686 1874 webserver.cc:460] Webserver started at http://127.30.78.124:33871/ using document root <none> and password file <none>
I20260809 06:37:23.444283 1874 fs_manager.cc:359] Metadata directory not provided
I20260809 06:37:23.444365 1874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260809 06:37:23.444626 1874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260809 06:37:23.447446 1874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/data/instance:
uuid: "2ca2d0824ee2406c96f75be24c173e72"
format_stamp: "Formatted at 2026-08-09 06:37:23 on dist-test-slave-cvwc"
server_key: "b5e5ca9b40bd3e2154e6b4fd42ee9559"
server_key_iv: "1f14463f6d8b189410ca450822ffe076"
server_key_version: "encryptionkey@0"
I20260809 06:37:23.448228 1874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/wal/instance:
uuid: "2ca2d0824ee2406c96f75be24c173e72"
format_stamp: "Formatted at 2026-08-09 06:37:23 on dist-test-slave-cvwc"
server_key: "b5e5ca9b40bd3e2154e6b4fd42ee9559"
server_key_iv: "1f14463f6d8b189410ca450822ffe076"
server_key_version: "encryptionkey@0"
I20260809 06:37:23.452955 1874 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260809 06:37:23.456166 1897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260809 06:37:23.457327 1874 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260809 06:37:23.457497 1874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/data,/tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/wal
uuid: "2ca2d0824ee2406c96f75be24c173e72"
format_stamp: "Formatted at 2026-08-09 06:37:23 on dist-test-slave-cvwc"
server_key: "b5e5ca9b40bd3e2154e6b4fd42ee9559"
server_key_iv: "1f14463f6d8b189410ca450822ffe076"
server_key_version: "encryptionkey@0"
I20260809 06:37:23.457679 1874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260809 06:37:23.474404 1743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } attempt: 3
I20260809 06:37:23.475409 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.474941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49482)
0809 06:37:23.475154 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.475238 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260809 06:37:23.476352 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.476022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49486)
0809 06:37:23.476169 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.476245 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260809 06:37:23.476553 1743 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.78.124:40537: Network error: Client connection negotiation failed: client connection to 127.30.78.124:40537: connect: Connection refused (error 111)
I20260809 06:37:23.489957 1874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260809 06:37:23.493736 1874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260809 06:37:23.493970 1874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260809 06:37:23.512274 1874 rpc_server.cc:307] RPC server started. Bound to: 127.30.78.124:40537
I20260809 06:37:23.512303 1972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.78.124:40537 every 8 connection(s)
I20260809 06:37:23.513617 1874 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/data/info.pb
I20260809 06:37:23.516403 31033 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklYlngI/build/asan/bin/kudu as pid 1874
I20260809 06:37:23.516585 31033 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklYlngI/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786257083636440-31033-0/minicluster-data/master-2/wal/instance
I20260809 06:37:23.517122 31033 external_mini_cluster.cc:1428] Setting key 9fcfe0b16a97140b7ecc9ed768c4bf73
I20260809 06:37:23.517655 1973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260809 06:37:23.527200 1973 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257443, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:37:23.542922 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.518942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49496 (local address 127.30.78.124:40537)
0809 06:37:23.519742 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.519755 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.519797 (+ 42us) server_negotiation.cc:407] Connection header received
0809 06:37:23.522826 (+ 3029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.522854 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.523333 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.523795 (+ 462us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.525521 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.527548 (+ 2027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.529284 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.530110 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.530275 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.534362 (+ 4087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.534380 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.534393 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.534433 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.537963 (+ 3530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.538690 (+ 727us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.538702 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.538710 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.538894 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.539979 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.539985 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.539987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.540485 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.540765 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.541253 (+ 488us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.541609 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":599,"thread_start_us":369,"threads_started":1}
I20260809 06:37:23.544603 1980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.529907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.126:33859 (local address 127.0.0.1:33754)
0809 06:37:23.530714 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.530769 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:23.530947 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:23.531338 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:23.531345 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:23.531926 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:23.532193 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.532203 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.533528 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.533532 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.534796 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.534813 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.535590 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.535597 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.535792 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.536469 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:23.536492 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:23.538883 (+ 2391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:23.541826 (+ 2943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.541835 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.541841 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.542394 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.542774 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.542779 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.542783 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.542995 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.543566 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:23.543573 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:23.543776 (+ 203us) client_negotiation.cc:769] Sending connection context
0809 06:37:23.543988 (+ 212us) client_negotiation.cc:240] Negotiation successful
0809 06:37:23.544292 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":428,"threads_started":1}
I20260809 06:37:23.544647 1747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.529763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33754 (local address 127.30.78.126:33859)
0809 06:37:23.529959 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.529966 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.530874 (+ 908us) server_negotiation.cc:407] Connection header received
0809 06:37:23.531092 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.531098 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.531169 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.531264 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.532358 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.533374 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.534942 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.535385 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.535490 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.539071 (+ 3581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.539077 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.539080 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.539115 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.541665 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.542521 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.542525 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.542527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.542660 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.543168 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.543172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.543175 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.543432 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.543558 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.544075 (+ 517us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.544290 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:37:23.545935 1973 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } has no permanent_uuid. Determining permanent_uuid...
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257443, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.126@KRBTEST.COM
I20260809 06:37:23.558312 1980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.546544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.125:35025 (local address 127.0.0.1:38740)
0809 06:37:23.546700 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.546717 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:23.546802 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:23.547194 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:23.547197 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:23.547503 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:23.547663 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.547675 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.548578 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.548581 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.549504 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.549516 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.550263 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.550269 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.550422 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.550970 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:23.550985 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:23.553053 (+ 2068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:23.556034 (+ 2981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.556039 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.556043 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.556500 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.556827 (+ 327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.556832 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.556836 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.557018 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.557502 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:23.557505 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:23.557622 (+ 117us) client_negotiation.cc:769] Sending connection context
0809 06:37:23.557778 (+ 156us) client_negotiation.cc:240] Negotiation successful
0809 06:37:23.558023 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260809 06:37:23.558399 1869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.546699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38740 (local address 127.30.78.125:35025)
0809 06:37:23.546907 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.546913 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.546935 (+ 22us) server_negotiation.cc:407] Connection header received
0809 06:37:23.546996 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.547002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.547076 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.547179 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.547809 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.548448 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.549643 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.550116 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.550235 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.553235 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.553242 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.553247 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.553286 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.555910 (+ 2624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.556602 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.556606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.556608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.556728 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.557109 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.557111 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.557114 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.557388 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.557531 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.557888 (+ 357us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.558044 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260809 06:37:23.559381 1973 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } has no permanent_uuid. Determining permanent_uuid...
I20260809 06:37:23.560052 1747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.545850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33760 (local address 127.30.78.126:33859)
0809 06:37:23.545996 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.546001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.546018 (+ 17us) server_negotiation.cc:407] Connection header received
0809 06:37:23.546110 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.546114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.546178 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.546276 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.547613 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.548387 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.549618 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.550083 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.550174 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.554468 (+ 4294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.554473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.554476 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.554504 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.557209 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.557894 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.557899 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.557902 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.558045 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.558488 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.558493 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.558496 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.558786 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.559051 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.559575 (+ 524us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.559771 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257443, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.124@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257441, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.78.125@KRBTEST.COM
I20260809 06:37:23.572468 1980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.560067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49512)
0809 06:37:23.560331 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.560349 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:23.560484 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:23.560788 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:23.560794 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:23.561175 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:23.561372 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.561387 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.562428 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.562434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.563777 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.563793 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.564694 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.564698 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.564902 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.565385 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:23.565406 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:23.567617 (+ 2211us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:23.570322 (+ 2705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.570327 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.570331 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.570658 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.570983 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.570988 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.570992 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.571112 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.571574 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:23.571578 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:23.571705 (+ 127us) client_negotiation.cc:769] Sending connection context
0809 06:37:23.571828 (+ 123us) client_negotiation.cc:240] Negotiation successful
0809 06:37:23.572094 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159}
I20260809 06:37:23.572620 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.560234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49512 (local address 127.30.78.124:40537)
0809 06:37:23.560377 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.560383 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.560401 (+ 18us) server_negotiation.cc:407] Connection header received
0809 06:37:23.560588 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.560594 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.560655 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.560737 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.561510 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.562306 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.563919 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.564530 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.564656 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.567787 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.567791 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.567794 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.567820 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.570210 (+ 2390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.570765 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.570771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.570774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.570877 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.571204 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.571210 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.571213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.571470 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.571590 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.571931 (+ 341us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.572291 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":112,"server-negotiator.queue_time_us":63}
I20260809 06:37:23.576318 1869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.561637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38756 (local address 127.30.78.125:35025)
0809 06:37:23.561827 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.561834 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.561882 (+ 48us) server_negotiation.cc:407] Connection header received
0809 06:37:23.562064 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.562069 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.562124 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.562202 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.563799 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.564824 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.566479 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.566883 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.566971 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.570863 (+ 3892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.570869 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.570874 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.570902 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.573948 (+ 3046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.574541 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.574546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.574549 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.574714 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.575049 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.575053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.575057 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.575361 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.575620 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.575778 (+ 158us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.575993 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260809 06:37:23.578392 1973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72: Bootstrap starting.
I20260809 06:37:23.580721 31033 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260809 06:37:23.581876 1973 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:23.582949 1973 log.cc:824] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:23.585590 1973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72: No bootstrap required, opened a new log
I20260809 06:37:23.583077 1702 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b5c45bbbd09d4492a207e1391d30b04d"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33760
I20260809 06:37:23.592399 1973 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } }
I20260809 06:37:23.592690 1973 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ca2d0824ee2406c96f75be24c173e72, State: Initialized, Role: FOLLOWER
I20260809 06:37:23.593084 1973 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } }
I20260809 06:37:23.593928 1983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.594282 1983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:23.594964 1973 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [sys.catalog]: configured and running, proceeding with master startup.
W20260809 06:37:23.603405 1996 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260809 06:37:23.603507 1996 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260809 06:37:23.601758 1874 master_runner.cc:186] Error getting master registration for 127.30.78.126:33859: OK, instance_id { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" instance_seqno: 1786257442515563 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:37:23.612321 1874 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 06:37:23.653757 1743 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } attempt: 4
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257442, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.126@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
I20260809 06:37:23.670145 1746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.654480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49526)
0809 06:37:23.654681 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.654703 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:23.654828 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:23.655208 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:23.655213 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:23.655719 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:23.655936 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.655948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.657365 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.657370 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.658853 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.658869 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.659835 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.659841 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.660029 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.660684 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:23.660706 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:23.663545 (+ 2839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:23.667432 (+ 3887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.667438 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.667442 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.667950 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.668324 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.668329 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.668333 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.668514 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.669127 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:23.669132 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:23.669316 (+ 184us) client_negotiation.cc:769] Sending connection context
0809 06:37:23.669456 (+ 140us) client_negotiation.cc:240] Negotiation successful
0809 06:37:23.669744 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260809 06:37:23.670214 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.654634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49526 (local address 127.30.78.124:40537)
0809 06:37:23.654856 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.654863 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.654916 (+ 53us) server_negotiation.cc:407] Connection header received
0809 06:37:23.654987 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.654993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.655069 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.655165 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.656090 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.657231 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.658999 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.659707 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.659830 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.663742 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.663750 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.663755 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.663794 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.667288 (+ 3494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.668065 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.668071 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.668075 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.668216 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.668619 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.668625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.668628 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.669023 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.669186 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.669572 (+ 386us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.669828 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:37:23.676215 1743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d: Bootstrap starting.
I20260809 06:37:23.680295 1743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:23.681656 1743 log.cc:824] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d: Log is configured to *not* fsync() on all Append() calls
I20260809 06:37:23.684926 1743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d: No bootstrap required, opened a new log
I20260809 06:37:23.692346 1743 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } }
I20260809 06:37:23.692731 1743 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5c45bbbd09d4492a207e1391d30b04d, State: Initialized, Role: FOLLOWER
I20260809 06:37:23.693219 1743 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } }
I20260809 06:37:23.694212 1999 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.694617 1999 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:23.695371 1743 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:23.695472 1702 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260809 06:37:23.695670 1702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:23.698663 1702 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } }
I20260809 06:37:23.699813 1702 leader_election.cc:288] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [CANDIDATE]: Term 1 election: Requested vote from peers ecf689e04cb54d14b9a9b2c99064c6fe (127.30.78.125:35025), 2ca2d0824ee2406c96f75be24c173e72 (127.30.78.124:40537)
I20260809 06:37:23.700682 1940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5c45bbbd09d4492a207e1391d30b04d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2ca2d0824ee2406c96f75be24c173e72"
I20260809 06:37:23.701170 1940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:23.704530 1940 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c45bbbd09d4492a207e1391d30b04d in term 1.
I20260809 06:37:23.705116 1668 leader_election.cc:302] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ca2d0824ee2406c96f75be24c173e72, b5c45bbbd09d4492a207e1391d30b04d; no voters:
I20260809 06:37:23.705546 1999 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [term 1 FOLLOWER]: Leader election won for term 1
I20260809 06:37:23.716205 1999 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [term 1 LEADER]: Becoming Leader. State: Replica: b5c45bbbd09d4492a207e1391d30b04d, State: Running, Role: LEADER
I20260809 06:37:23.717167 1999 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } }
I20260809 06:37:23.721625 1864 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } attempt: 5
I20260809 06:37:23.730338 2006 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5c45bbbd09d4492a207e1391d30b04d. Latest consensus state: current_term: 1 leader_uuid: "b5c45bbbd09d4492a207e1391d30b04d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.730737 2006 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [sys.catalog]: This master's current role is: LEADER
Aug 09 06:37:23 dist-test-slave-cvwc krb5kdc[1617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786257442, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.78.125@KRBTEST.COM for kudu/127.30.78.124@KRBTEST.COM
I20260809 06:37:23.740782 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.722935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49538 (local address 127.30.78.124:40537)
0809 06:37:23.723104 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.723109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.723128 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:37:23.723180 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.723186 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.723278 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.723370 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.724478 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.725628 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.727436 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.728159 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.728275 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.732370 (+ 4095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.732378 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.732383 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.732420 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.735941 (+ 3521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.737092 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.737101 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.737105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.737372 (+ 267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.738048 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.738054 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.738057 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.738639 (+ 582us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.738840 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.739693 (+ 853us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.740092 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260809 06:37:23.742287 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.722224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.78.124:40537 (local address 127.0.0.1:49538)
0809 06:37:23.722583 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0809 06:37:23.722603 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0809 06:37:23.722716 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0809 06:37:23.723567 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0809 06:37:23.723573 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0809 06:37:23.724092 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0809 06:37:23.724300 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.724312 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.725798 (+ 1486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.725804 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.727242 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0809 06:37:23.727258 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.728476 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.728483 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0809 06:37:23.728707 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.729350 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0809 06:37:23.729372 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0809 06:37:23.732163 (+ 2791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0809 06:37:23.736107 (+ 3944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.736113 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.736118 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.736895 (+ 777us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.737619 (+ 724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0809 06:37:23.737624 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0809 06:37:23.737628 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0809 06:37:23.737884 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0809 06:37:23.738980 (+ 1096us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0809 06:37:23.738985 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0809 06:37:23.739219 (+ 234us) client_negotiation.cc:769] Sending connection context
0809 06:37:23.740736 (+ 1517us) client_negotiation.cc:240] Negotiation successful
0809 06:37:23.741676 (+ 940us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228}
W20260809 06:37:23.745911 1904 tablet.cc:2369] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:37:23.748145 1864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe: Bootstrap starting.
I20260809 06:37:23.748710 2023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260809 06:37:23.752111 1864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe: Neither blocks nor log segments found. Creating new log.
I20260809 06:37:23.753350 1864 log.cc:824] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe: Log is configured to *not* fsync() on all Append() calls
W20260809 06:37:23.755236 1672 tablet.cc:2369] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260809 06:37:23.761040 1864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe: No bootstrap required, opened a new log
I20260809 06:37:23.768378 2023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260809 06:37:23.769747 1869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.729353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38758 (local address 127.30.78.125:35025)
0809 06:37:23.729503 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.729509 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.745128 (+ 15619us) server_negotiation.cc:407] Connection header received
0809 06:37:23.745500 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.745506 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.745580 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.745649 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.749528 (+ 3879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.750644 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.753851 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.754485 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.754573 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.760333 (+ 5760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.760341 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.760346 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.760384 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.765296 (+ 4912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.766689 (+ 1393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.766694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.766697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.766864 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.767573 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.767578 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.767581 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.767939 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.768183 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.769106 (+ 923us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.769370 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260809 06:37:23.773627 1747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.743685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33762 (local address 127.30.78.126:33859)
0809 06:37:23.743836 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.743842 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.746235 (+ 2393us) server_negotiation.cc:407] Connection header received
0809 06:37:23.747535 (+ 1300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.747540 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.747615 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.747687 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.752261 (+ 4574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.753306 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.756252 (+ 2946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.756920 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.757021 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.760484 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.760490 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.760494 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.760529 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.765400 (+ 4871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.770449 (+ 5049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.770455 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.770458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.770637 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.771585 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.771591 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.771594 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.771961 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.772236 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.773007 (+ 771us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.773266 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260809 06:37:23.777220 1979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:23.746661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49548 (local address 127.30.78.124:40537)
0809 06:37:23.746863 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.746868 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.756455 (+ 9587us) server_negotiation.cc:407] Connection header received
0809 06:37:23.756709 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.756715 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.756791 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.756853 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.761695 (+ 4842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.762748 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.764466 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:23.765054 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:23.765150 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:23.768203 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0809 06:37:23.768210 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0809 06:37:23.768214 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0809 06:37:23.768254 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0809 06:37:23.771802 (+ 3548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.772689 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.772696 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.772699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.773017 (+ 318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0809 06:37:23.774103 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0809 06:37:23.774113 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0809 06:37:23.774117 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0809 06:37:23.774744 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0809 06:37:23.775203 (+ 459us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:23.776169 (+ 966us) server_negotiation.cc:299] Negotiation successful
0809 06:37:23.776614 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260809 06:37:23.790133 2039 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 06:37:23.791471 1940 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [term 1 FOLLOWER]: Refusing update from remote peer b5c45bbbd09d4492a207e1391d30b04d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:37:23.792520 1999 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:37:23.794601 1864 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } }
I20260809 06:37:23.794986 1864 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf689e04cb54d14b9a9b2c99064c6fe, State: Initialized, Role: FOLLOWER
I20260809 06:37:23.795451 1864 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } }
I20260809 06:37:23.794011 1640 master_runner.cc:186] Error getting master registration for 127.30.78.125:35025: OK, instance_id { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" instance_seqno: 1786257443003967 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260809 06:37:23.804906 1640 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260809 06:37:23.810796 2040 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.811190 2040 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:23.811899 1864 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [sys.catalog]: configured and running, proceeding with master startup.
I20260809 06:37:23.811977 1825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5c45bbbd09d4492a207e1391d30b04d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe"
I20260809 06:37:23.812465 1825 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [term 0 FOLLOWER]: Advancing to term 1
I20260809 06:37:23.815963 1825 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5c45bbbd09d4492a207e1391d30b04d in term 1.
I20260809 06:37:23.816650 1823 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [term 1 FOLLOWER]: Refusing update from remote peer b5c45bbbd09d4492a207e1391d30b04d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260809 06:37:23.818359 1999 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260809 06:37:23.837013 2033 mvcc.cc:205] Tried to move back new op lower bound from 7316510489755746304 to 7316510489475784704. Current Snapshot: MvccSnapshot[applied={T|T < 7316510489755746304}]
I20260809 06:37:23.838156 1983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5c45bbbd09d4492a207e1391d30b04d. Latest consensus state: current_term: 1 leader_uuid: "b5c45bbbd09d4492a207e1391d30b04d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.838470 1983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:23.840219 1999 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5c45bbbd09d4492a207e1391d30b04d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.840621 1999 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:23.845366 2023 catalog_manager.cc:1347] Generated new cluster ID: 216ad743fec748eeaac411c36a5f30ea
I20260809 06:37:23.845474 2023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260809 06:37:23.850757 2040 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5c45bbbd09d4492a207e1391d30b04d. Latest consensus state: current_term: 1 leader_uuid: "b5c45bbbd09d4492a207e1391d30b04d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.851058 2040 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:23.852422 1999 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5c45bbbd09d4492a207e1391d30b04d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.852687 1999 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d [sys.catalog]: This master's current role is: LEADER
I20260809 06:37:23.862258 1983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5c45bbbd09d4492a207e1391d30b04d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.862495 1983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72 [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:23.872294 2040 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5c45bbbd09d4492a207e1391d30b04d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5c45bbbd09d4492a207e1391d30b04d" member_type: VOTER last_known_addr { host: "127.30.78.126" port: 33859 } } peers { permanent_uuid: "ecf689e04cb54d14b9a9b2c99064c6fe" member_type: VOTER last_known_addr { host: "127.30.78.125" port: 35025 } } peers { permanent_uuid: "2ca2d0824ee2406c96f75be24c173e72" member_type: VOTER last_known_addr { host: "127.30.78.124" port: 40537 } } }
I20260809 06:37:23.872532 2040 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe [sys.catalog]: This master's current role is: FOLLOWER
I20260809 06:37:23.897146 2023 catalog_manager.cc:1370] Generated new certificate authority record
I20260809 06:37:23.899091 2023 catalog_manager.cc:1504] Loading token signing keys...
I20260809 06:37:23.901474 2068 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260809 06:37:23.924321 2023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5c45bbbd09d4492a207e1391d30b04d: Generated new TSK 0
I20260809 06:37:23.925323 2023 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260809 06:37:23.994143 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:23.991467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38768 (local address 127.30.78.125:35025)
0809 06:37:23.991691 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.991698 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.992073 (+ 375us) server_negotiation.cc:407] Connection header received
0809 06:37:23.992377 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.992385 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.992478 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.992556 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.993885 (+ 1329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38768: BlockingRecv error: recv got EOF from 127.0.0.1:38768 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 06:37:23.996371 1979 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:23.992251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49552 (local address 127.30.78.124:40537)
0809 06:37:23.992432 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.992437 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.994740 (+ 2303us) server_negotiation.cc:407] Connection header received
0809 06:37:23.995000 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.995007 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.995097 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.995166 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.996116 (+ 950us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49552: BlockingRecv error: recv got EOF from 127.0.0.1:49552 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260809 06:37:23.999562 1747 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:23.997232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33778 (local address 127.30.78.126:33859)
0809 06:37:23.997439 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:23.997445 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:23.997956 (+ 511us) server_negotiation.cc:407] Connection header received
0809 06:37:23.998201 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:23.998207 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:23.998286 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:23.998362 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:23.999310 (+ 948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33778: BlockingRecv error: recv got EOF from 127.0.0.1:33778 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260809 06:37:24.007890 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.003867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38774 (local address 127.30.78.125:35025)
0809 06:37:24.004013 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.004017 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.006618 (+ 2601us) server_negotiation.cc:407] Connection header received
0809 06:37:24.006796 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.006800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.006895 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.006978 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.007650 (+ 672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38774: BlockingRecv error: recv got EOF from 127.0.0.1:38774 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260809 06:37:24.042495 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.040459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38784 (local address 127.30.78.125:35025)
0809 06:37:24.040640 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.040646 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.041201 (+ 555us) server_negotiation.cc:407] Connection header received
0809 06:37:24.041413 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.041417 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.041484 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.041562 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.042288 (+ 726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38784: BlockingRecv error: recv got EOF from 127.0.0.1:38784 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 06:37:24.049228 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.047548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38798 (local address 127.30.78.125:35025)
0809 06:37:24.047707 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.047712 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.047988 (+ 276us) server_negotiation.cc:407] Connection header received
0809 06:37:24.048162 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.048167 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.048232 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.048307 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.049071 (+ 764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38798: BlockingRecv error: recv got EOF from 127.0.0.1:38798 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260809 06:37:24.061088 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.059200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38808 (local address 127.30.78.125:35025)
0809 06:37:24.059414 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.059421 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.059862 (+ 441us) server_negotiation.cc:407] Connection header received
0809 06:37:24.060043 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.060049 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.060120 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.060205 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.060870 (+ 665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38808: BlockingRecv error: recv got EOF from 127.0.0.1:38808 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260809 06:37:24.073815 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.071743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38812 (local address 127.30.78.125:35025)
0809 06:37:24.071925 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.071931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.072354 (+ 423us) server_negotiation.cc:407] Connection header received
0809 06:37:24.072607 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.072611 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.072674 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.072755 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.073588 (+ 833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38812: BlockingRecv error: recv got EOF from 127.0.0.1:38812 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260809 06:37:24.094666 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.092635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38824 (local address 127.30.78.125:35025)
0809 06:37:24.092806 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.092813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.093315 (+ 502us) server_negotiation.cc:407] Connection header received
0809 06:37:24.093504 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.093508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.093585 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.093667 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.094437 (+ 770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38824: BlockingRecv error: recv got EOF from 127.0.0.1:38824 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260809 06:37:24.132330 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.130344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38834 (local address 127.30.78.125:35025)
0809 06:37:24.130579 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.130586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.130947 (+ 361us) server_negotiation.cc:407] Connection header received
0809 06:37:24.131137 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.131141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.131213 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.131302 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.132085 (+ 783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38834: BlockingRecv error: recv got EOF from 127.0.0.1:38834 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260809 06:37:24.202592 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.200091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38846 (local address 127.30.78.125:35025)
0809 06:37:24.200289 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.200296 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.201079 (+ 783us) server_negotiation.cc:407] Connection header received
0809 06:37:24.201302 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.201308 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.201414 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.201528 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.202355 (+ 827us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38846: BlockingRecv error: recv got EOF from 127.0.0.1:38846 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260809 06:37:24.337267 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.335302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38858 (local address 127.30.78.125:35025)
0809 06:37:24.335512 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.335519 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.335872 (+ 353us) server_negotiation.cc:407] Connection header received
0809 06:37:24.336085 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.336090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.336167 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.336255 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.337012 (+ 757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38858: BlockingRecv error: recv got EOF from 127.0.0.1:38858 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260809 06:37:24.598757 1869 negotiation.cc:337] Failed RPC negotiation. Trace:
0809 06:37:24.596836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38862 (local address 127.30.78.125:35025)
0809 06:37:24.597060 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:24.597067 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:24.597296 (+ 229us) server_negotiation.cc:407] Connection header received
0809 06:37:24.597528 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:24.597533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:24.597608 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:24.597697 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0809 06:37:24.598517 (+ 820us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38862: BlockingRecv error: recv got EOF from 127.0.0.1:38862 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260809 06:37:24.605368 1996 catalog_manager.cc:1259] Loaded cluster ID: 216ad743fec748eeaac411c36a5f30ea
I20260809 06:37:24.605458 1996 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72: loading cluster ID for follower catalog manager: success
I20260809 06:37:24.607894 1996 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72: acquiring CA information for follower catalog manager: success
I20260809 06:37:24.609593 1996 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2ca2d0824ee2406c96f75be24c173e72: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:37:24.905659 2068 catalog_manager.cc:1259] Loaded cluster ID: 216ad743fec748eeaac411c36a5f30ea
I20260809 06:37:24.905810 2068 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe: loading cluster ID for follower catalog manager: success
I20260809 06:37:24.908363 2068 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe: acquiring CA information for follower catalog manager: success
I20260809 06:37:24.910212 2068 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ecf689e04cb54d14b9a9b2c99064c6fe: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260809 06:37:25.121276 2159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:25.114571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38874 (local address 127.30.78.125:35025)
0809 06:37:25.115376 (+ 805us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:25.115381 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:25.115400 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:37:25.115462 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:25.115466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:25.115596 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:25.115706 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:25.116207 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.117037 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.118995 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.119425 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.119519 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:25.120121 (+ 602us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:25.120618 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:25.120723 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:25.120877 (+ 154us) server_negotiation.cc:299] Negotiation successful
0809 06:37:25.120942 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":547,"threads_started":1}
I20260809 06:37:25.132892 2167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:25.127522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49558 (local address 127.30.78.124:40537)
0809 06:37:25.128099 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:25.128104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:25.128124 (+ 20us) server_negotiation.cc:407] Connection header received
0809 06:37:25.128217 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:25.128221 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:25.128355 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:25.128513 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:25.128899 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.129615 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.130873 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.131259 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.131376 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:25.131846 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:25.132307 (+ 461us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:25.132443 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:25.132539 (+ 96us) server_negotiation.cc:299] Negotiation successful
0809 06:37:25.132626 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":357,"threads_started":1}
I20260809 06:37:25.158999 2177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:25.139596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33794 (local address 127.30.78.126:33859)
0809 06:37:25.151828 (+ 12232us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:25.151833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:25.151852 (+ 19us) server_negotiation.cc:407] Connection header received
0809 06:37:25.151991 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:25.151998 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:25.152209 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:25.152387 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:25.153307 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.154368 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.156352 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.156976 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.157072 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:25.157811 (+ 739us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:25.158254 (+ 443us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:25.158344 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:25.158596 (+ 252us) server_negotiation.cc:299] Negotiation successful
0809 06:37:25.158683 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12118,"thread_start_us":12920,"threads_started":1}
I20260809 06:37:25.159658 2159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:25.140052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38882 (local address 127.30.78.125:35025)
0809 06:37:25.140228 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:25.140236 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:25.153257 (+ 13021us) server_negotiation.cc:407] Connection header received
0809 06:37:25.153363 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:25.153380 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:25.153457 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:25.153539 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:25.154257 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.155311 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.157363 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.157991 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.158087 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:25.158745 (+ 658us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:25.158862 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:25.158920 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:25.159362 (+ 442us) server_negotiation.cc:299] Negotiation successful
0809 06:37:25.159447 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260809 06:37:25.164381 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1640
I20260809 06:37:25.165309 1738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:37:25.166766 2167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0809 06:37:25.151690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49568 (local address 127.30.78.124:40537)
0809 06:37:25.151841 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0809 06:37:25.151847 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0809 06:37:25.159045 (+ 7198us) server_negotiation.cc:407] Connection header received
0809 06:37:25.159449 (+ 404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0809 06:37:25.159456 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0809 06:37:25.159558 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0809 06:37:25.159623 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0809 06:37:25.160631 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.161690 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.163785 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0809 06:37:25.164344 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0809 06:37:25.164487 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0809 06:37:25.166000 (+ 1513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0809 06:37:25.166125 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0809 06:37:25.166187 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0809 06:37:25.166419 (+ 232us) server_negotiation.cc:299] Negotiation successful
0809 06:37:25.166501 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260809 06:37:25.294090 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1640
W20260809 06:37:25.320796 1778 connection.cc:535] server connection from 127.0.0.1:38734 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260809 06:37:25.321223 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1755
I20260809 06:37:25.322261 1859 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:37:25.425820 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1755
I20260809 06:37:25.449944 31033 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasklYlngI/build/asan/bin/kudu pid 1874
I20260809 06:37:25.451030 1967 generic_service.cc:196] Checking for leaks (request via RPC)
I20260809 06:37:25.555181 31033 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklYlngI/build/asan/bin/kudu with pid 1874
2026-08-09T06:37:25Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4950 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9878 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (361891 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST